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TUTORIAL 


THE  USE  OF  OFFSETS  IN 
FOREIGN  MILITARY  SALES 

It  Col  Robert  1.  Waller,  USAF  (Ret) 

United  States  defense  firms  have  increasingly  encountered  demands  from  their 
foreign  buyers  to  provide  compensation  for  selecting  U.S.  suppliers.  These  quid 
pro  quo  transactions,  also  known  as  offsets,  compensate  the  buyers  for  the 
economic  damage  caused  by  purchasing  costly  U.S.  defense  equipment.  While 
these  offsets  may  appear  to  be  solely  a  form  of  price  cutting,  the  motives  of  the 
foreign  buyers  can  be  varied.  The  behavior  of  these  buyers  can  be  explained 
by  economic  incentives  ranging  from  labor  market  distortions  and  desires  for 
foreign  investment  to  the  need  for  international  financing.  In  most  cases,  it 
appears  that  offset  transactions  are  a  form  of  commercial  policy  that  the  buying 
governments  use  to  address  domestic  problems.  Defense  industry  personnel 
will  likely  encounter  offset  transactions  and  will  benefit  from  a  better 
understanding  of  the  buyers’  motivations. 


In  the  1980s,  I  studied  and  wrote  about 
the  use  of  offsets  in  defense  sales  to 
foreign  governments.1  (The  term  off¬ 
sets  is  used  in  defense  sales  to  mean  the 
compensation  given  to  foreign  buyers, 
by  U.S.  sellers,  to  offset  the  economic 
impact  on  the  foreign  buyers  from  hav¬ 
ing  purchased  U.S.  made  items,  rather 
than  domestically-produced  items.) 
Since  the  time  of  that  writing,  the  de¬ 
fense  environment  has  undergone  sig¬ 
nificant  changes  with  the  end  of  the  Cold 
War  and  the  breakup  of  the  Warsaw  Pact, 
mergers  within  the  defense  industry,  and 
the  changing  level  and  nature  of  the  threat. 


With  a  changed  defense  environment, 
there  is  a  need  to  reexamine  the  issue 
of  offsets  and  to  validate  the  economic 
explanations  of  why  buying  nations  re¬ 
quest,  and  even  demand,  offsets  when 
purchasing  foreign-made  defense  items. 

To  gain  an  understanding  of  the  cur¬ 
rent  environment  surrounding  offsets  in 
the  defense  industry,  officials  in  the  in¬ 
dustry  were  contacted  and,  when  will¬ 
ing,  questioned  about  their  experiences.2 
Because  of  the  proprietary  nature  of  the 
information,  and  the  fact  that  competi¬ 
tions  involving  offsets  are  currently  on¬ 
going,  few  specifics  can  be  identified  in 
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this  article;  however,  the  general  moti¬ 
vations  behind  the  use  of  offsets  are 
presented. 

Offset  agreements  appear  to  be  com¬ 
mon  in  large  defense  sales  of  aircraft,  radars, 
and  other  electronic  systems,  to  foreign 
governments.  In  fact,  it  appears  that  off¬ 
set  agreements  are  the  norm  in  such  trans¬ 
actions.  In  a  typical  offset  arrangement, 
the  buying  country 
(who  most  likely  has  a 
formal  offsets  policy  or 
even  a  law  governing 
offsets)3  requires  the 
selling  firm  to  provide 
economic  offsets  or 
compensation  for  hav¬ 
ing  purchased  the  par¬ 
ticular  foreign-made 
system  or  items.  The 
offsets  may  include 
purchases  by  the  sell¬ 
ing  firm  from  the  buy¬ 
ing  nation,  as  well  as 
marketing  assistance 
for,  investments  in.  or 
technology  transfers  to  the  buying  na¬ 
tion.  The  seller  may  also  agree  to  pro¬ 
duce  a  portion  of  the  product  in  the 
buyer’s  country.  The  value  of  the  off¬ 
sets  expected  by  the  buying  nations  fre¬ 
quently  equals  the  value  of  the  original 
defense  purchases,  and  the  time  re¬ 
quired  to  fulfill  the  offset  commitments 
may  easily  exceed  the  delivery  time  for 
the  purchased  defense  equipment.4 

It  appears  that  the  current  competi¬ 
tive  environment  in  the  worldwide  de¬ 
fense  industry  dictates  that  a  selling  firm 
must  anticipate  offering  offsets  to  the 
buyer  to  have  any  reasonable  chance 
of  winning  a  sale.  With  the  frequent 
use  of  offsets,  it  is  logical  to  ask,  what 


"It  appears 
•hat  the  current 
competitive 
environment  in 
the  worldwide 


aKiuivs  inai  a 


buyer  to 


any 


off  winnlna  a 

w  «  ww  imm him  mm 

sale." 


motivates  a  buying  nation  to  request  or 
require  offsets?  Why  would  a  buyer  choose 
this  type  of  transaction,  a  purchase  con¬ 
tract  accompanied  by  an  offset  agreement, 
when  a  simpler,  more  straightforward  cash 
deal  is  available  and  might  result  in  a 
cheaper  price  for  the  defense  item?  An 
initial  response  might  be  that  the  buying 
nation  has  some  monopsony  power  and 
the  nation  uses  that  power  in  a  competi¬ 
tive  environment  to  win  an  effective  price 
reduction.  While  this  may  be  true  in  some 
cases,  it  is  also  reasonable  to  assume  that 
in  many  cases  the  selling  firms  have  to 
cover  the  costs  of  fulfilling  their  offset 
commitments  and  thus  must  increase  the 
prices  of  the  defense  items  accompany¬ 
ing  these  commitments.5 

If  the  latter  is  true,  and  firms  do  increase 
the  prices  of  the  defense  items  in  order  to 
cover  the  offsets’  costs,  then  the  purchase 
and  combined  offsets  package  can  be 
equated  to  a  form  of  subsidization.  The 
buyer  pays  more  than  a  straight  cash  price, 
and  in  return  receives  certain  benefits  (dis¬ 
cussed  below).  The  alternative  for  the 
buyer  would  be  to  pay  a  lower  price  for 
the  required  defense  items  and  then 
provide  the  subsidization  for  the  desired 
benefits  directly  out  of  public  funds.  How¬ 
ever,  the  direct  subsidization  may  not  be 
possible  due  to  political  constraints.  Thus, 
offsets  may  be  considered  a  form  of 
indirect  subsidization,  and  possibly  a 
second-best,  or  blunt  form  of  government 
intervention  or  commercial  policy. 


The  Motives 


Discussion  of  some  of  the  motives  that 
buying  countries  may  have  when  they 
require  offsets  from  foreign  suppliers  of 
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defense  equipment  follows.  These  mo¬ 
tives  go  beyond  that  of  obtaining  an 
effective  price  cut,  and,  in  several  cases, 
appear  to  be  efforts  to  subsidize  certain 
activities. 

Corrections  in  the  Labor  Market 

A  buying  country  may  face  a  situation 
where  an  excessively  large  pool  of  un¬ 
employed  labor  exists  in  the  country,  or  a 
significant  percentage  of  its  workforce  is 
in  low-skilled  industries.  Either  case  may 
justify  some  form  of  government  action. 
Stimulative  macroeconomic  policy,  elimi¬ 
nation  of  the  minimum  wage,  or  a  reduc¬ 
tion  in  barriers  that  hinder  the  mobility  of 
labor  (from,  say,  union  power  or  govern¬ 
ment  regulations),  might  address  the  first 
situation.  A  subsidy  program  targeting 
certain  industries  could  be  used  to  in¬ 
crease  employment  in  high-skilled  areas, 
thus  addressing  the  second  case.  How¬ 
ever,  political  constraints  may  prevent  the 
use  of  some  of  these  actions.  Thus,  a  gov¬ 
ernment  might  seek  other  ways  to  ad¬ 
dress  the  labor  market  problem,  and  an 
offset  agreement  might  be  part  of  the  so¬ 
lution. 

Through  an  offset  arrangement,  the 
buying  government  can  increase  its 
exports  and  thus  stimulate  employment. 
In  particular,  the  government  can  require 
the  selling  firm  to  agree  to  buy  products 
produced  in  the  buying  country,  or  to 
establish  certain  co-production  and  sub¬ 
contracting  relationships  with  local  firms. 
The  buying  government  can,  therefore, 
ensure  that  certain  components  or  tasks 
associated  with  desired  high-tech  skills  be 
produced  in  its  local  economy,  thus  not 
only  increasing  employment  in  general 
but  increasing  the  skill  level  of  a  portion 
of  the  workforce. 


The  use  of  offsets  could  be  viewed,  in 
an  economic  setting,  as  a  form  of  govern¬ 
ment  intervention  in  response  to  a  distor¬ 
tion  in  the  local  labor  market.  In  the 
hypothetical  cases  described  above,  per¬ 
haps  the  minimum  wage,  excessive  union 
power,  or  government-imposed  barriers  are 
causing  unemployment  in  the  local 
economy.  However,  due  to  political  con¬ 
straints  these  factors  may  be  well  en¬ 
trenched  in  the  nation,  and  perhaps  the 
offsets  package  is  a  second-best  method 
of  addressing  the  distortion  in  the  labor 
market;  the  first  best  being  removal  of  the 
distortion  itself.  Additionally,  in  the  case 
where  there  is  a  lack  of  high-skilled 
employment  opportunities,  the  govern¬ 
ment’s  use  of  offsets  could  be  in  lieu  of, 
say,  a  politically-charged 
direct  subsidy  to  selected 
high-technology  firms  to 
encourage  employment 
in  those  industries. 

Anecdotal  evidence 
supports  this  theory  of 
the  use  of  offsets.  In¬ 
dustry  officials  report 
that  it  is  common  for 
countries  to  include  in  their  offset  re¬ 
quirements  a  list  of  general  categories 
of  technologies  that  are  desired,  and  to 
discuss  specific  technologies  during  ne¬ 
gotiations.  To  encourage  employment  in 
certain  targeted  industries  or  in  depressed 
regions,  the  buying  nations  may  award 
selling  firms  additional  offset  credit  for 
purchases  made  from  those  industries  or 
from  firms  within  the  designated  regions. 


countries.' 


n 


Enhance  Capital  Investment 

National  leaders  often  desire  to  see  an 
increase  in  investment  activity  in  their 
countries.  This  activity  would  bring  an 
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increase  in  employment,  particularly  in 
targeted  advanced  skills,  and,  in  the  case 
of  developing  countries,  an  increase  in 
national  pride  from  the  expanded  capital 
stock.  The  usual  macroeconomic  tools 
available  to  policymakers  to  encourage 
an  increase  in  investment  are  those  as¬ 
sociated  with  monetary  policy,  such  as 
an  easing  of  interest  rates  or  credit  con¬ 
ditions,  or  some  type  of  stimulative  fis¬ 
cal  policy,  such  as  an  investment  tax 
credit.  In  addition,  policymakers  might 
use  direct  subsidies  to  specific  indus¬ 
tries  to  promote  investment  activity. 
However,  once  again,  these  tools  may 
not  be  suitable  or  available. 

The  use  of  stimula¬ 
tive  monetary  and  fis¬ 
cal  policies  might  be 
restricted  because  of 
domestic  inflation  con¬ 
cerns  or  worries  about 
the  budget  deficit.  Us¬ 
ing  direct  subsidies, 
given  only  to  targeted 
industries,  would  likely  cause  political 
problems;  industries  not  subsidized 
would  feel  left  out,  and  labor  might  feel 
that  handouts  to  industry  were  too  gen¬ 
erous.  Therefore,  national  leaders  could 
use  offset  agreements  to  provide  stimu¬ 
lus  to  investment  activity  while  avoid¬ 
ing  political  friction. 

In  the  offset  negotiations,  the  buying 
government  can  request  that  the  selling 
firm  build  a  production  facility  in  the  buy¬ 
ing  country  or  use  its  influence  to  encour¬ 
age  other  domestic  firms,  such  as  subcon¬ 
tractors,  to  do  so.  In  this  way,  the  buying 
government  sees  an  increase  in  capital  in¬ 
vestment,  without  the  political  problems 
associated  with  a  direct  subsidy  scheme. 
Since  the  selling  firm  must  recoup  the 


"OftonMnes 
gowra—nts 
ghre  tuiuctud 
industries  a 
f  favorud  status." 


cost  of  the  possible  sub-optimal  invest¬ 
ment  decisions  by  increasing  the  price 
of  the  defense  equipment,  the  offsets 
arrangement  may  be  viewed  as  an  indi¬ 
rect  subsidy  scheme.  The  buyer  pays  a 
higher  price  for  the  defense  item,  but 
receives  the  desired  investment  activ¬ 
ity. 

Industry  officials  report  that  in  addition 
to  the  desired  capital  investment,  buying 
governments,  recognizing  their  limited 
domestic  demand  to  absorb  the  new  out¬ 
put,  often  expect  assistance  with  market¬ 
ing  the  output  from  these  new  facilities  in 
third  countries.  Thus,  an  offsets  agreement 
may  not  only  call  for  capital  investment 
in  the  buying  nation,  but  also  marketing 
assistance  for  the  output;  thus  making  the 
facility  a  viable  project  from  the  very 
beginning.  An  interesting  twist  to  this 
arrangement  is  when  the  selling  firm 
builds  a  facility  in  the  buying  country  and 
then  is  able  to  use  this  facility  to  create  a 
new  marketing  channel  for  itself,  perhaps 
providing  parts  and  components  to  service 
the  facility.6 

Promote  Strategic  Industries 

Oftentimes  governments  give  selected 
industries  a  favored  status.  This  special 
status  may  be  due  to  political  reasons, 
specifically  a  desire  for  military  self- 
sufficiency.  To  support  these  targeted 
industries,  government  policymakers  may 
call  for  subsidy  payments  to  the  firms  to 
ensure  their  viability.  However,  these 
direct  and  overt  subsidies  can  cause 
political  problems.  Industries  not  selected 
for  support  may  complain  about  the  dis¬ 
criminatory  subsidies.  Labor  groups  not 
associated  with  the  targeted  firms  may  also 
complain.  Critics  of  government  interven¬ 
tion  will  likely  find  fault  with  the  use  of 
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public  funds  to  assist  selected  private 
industry  or  to  support  inefficient  public 
firms.  To  avoid  these  political  battles  and 
still  obtain  the  desired  subsidization, 
government  leaders  may  turn  to  offsets. 

Similar  to  the  scenario  above,  when 
policymakers  want  to  increase  employ¬ 
ment  in  certain  high-technology  indus¬ 
tries,  offset  agreements  can  be  structured 
to  channel  business  toward  the  targeted 
firms,  including  the  award  of  extra  offset 
credit  for  purchases  made  from  these 
selected  firms.  Again,  this  use  of  offsets 
mimics  a  subsidization  scheme.  If  it  is 
assumed  that  the  offset-granting  firm 
raises  the  price  of  its  defense  items  to 
cover  the  cost  of  providing  the  offsets,  then 
the  buying  government  is  providing  an 
indirect,  and  less  visible,  form  of  subsidi¬ 
zation  to  the  targeted  industries. 

Correct  for  Asymmetric  Information 

A  government’s  use  of  offsets  can  also 
be  viewed  as  a  reaction  to  the  existence 
of  asymmetric  information.  First,  many 
of  the  major  defense  firms  have  well  de¬ 
veloped  worldwide  marketing  networks 
and  expertise,  while  the  nations  buying 
their  products  lack  the  extensive  market¬ 
ing  skills  needed  to  promote  their  own 
countries’  exports.  Second,  most  of  the 
buying  nations  of  defense  items  have  a 
need  to  increase  their  technological  bases, 
while  the  firms  selling  them  defense  items 
are  leaders  in  a  variety  of  technologies. 
Both  of  these  cases  represent  situations 
of  asymmetric  information;  the  sellers  pos¬ 
sess  information  that  the  buying  nations 
desire,  that  is,  marketing  expertise  and 
state-of-the-art  technologies. 

In  both  the  situations  described  here, 
offset  agreements  can  be  used  to  correct 
the  information  gaps.  A  buyer  of  defense 


items  can  request  that  the  selling  firm 
assist  in  marketing  the  buying  nation’s 
products  to  new  customers,  using  the 
firm’s  extensive  marketing  network, 
including  the  contacts  of  its  subcontractors. 
The  buyer  may  also  award  offset  credit 
for  the  value  of  technological  information 
that  is  transferred,  possibly  through  train¬ 
ing  programs,  to  the  buying  country.  In 
this  manner,  the  buying  nation  has  taken 
corrective  action  to  address  the  exist¬ 
ence  of  asymmetric  information,  im¬ 
proving  its  marketing  expertise  and  its 
technological  base;  and,  in  the  case  of 
the  marketing  assistance,  the  nation  has 
reduced  some  of  the  transaction  costs 
associated  with  its  exports. 


"Economic  theory 
usually  assumes 
that  agents,  for 
a  given  return  or 
level  of  output, 
prefer  to  reduce 
risk  whenever 
possible." 


Reduce  Risk  and  Uncertainty 

Economic  theory 
usually  assumes  that 
agents,  for  a  given  re¬ 
turn  or  level  of  output, 
prefer  to  reduce  risk 
whenever  possible. 

This  assumption  ap¬ 
plies  to  government 
policymakers  also.  As 
an  example,  decision 
makers  in  a  country 
may  wish  to  reduce  the 
risk  and  uncertainty  associated  with  a 
large  capital  investment,  say,  some  type 
of  production  facility.  Specifically,  they 
may  be  concerned  that  sufficient  de¬ 
mand  for  the  output  of  the  new  facility 
is  lacking,  and  thus  the  large  project  will 
fail,  embarrassing  the  country,  putting 
government  funds  at  risk,  and 
increasing  unemployment. 

In  a  situation  such  as  this,  these  gov¬ 
ernment  policymakers  could  use  off¬ 
sets  to  reduce  the  risk  and  uncertainty 
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associated  with  the  highly  visible 
project.  By  identifying  the  products 
from  the  facility  in  the  targeted  list  of 
items  for  the  defense  firm  to  help  mar¬ 
ket,  the  government  officials  could  in¬ 
crease  the  likelihood  of  success  for  the 
project  in  return  for  offset  credit.  As  in 
the  earlier  offsets  incentives  discussed 
above,  this  use  of  offsets  could  be  seen 
as  another  form  of  subsidization.  Here, 
the  buying  government  may  pay  a 
higher  price  for  the  defense  items,  but 
in  return  gets  assistance  in  marketing 
the  products  from  a  politically  sensitive 
project,  thus  reducing 
the  associated  risk. 


"Policymakers 
in  the  buying 
country  may  see 
the  use  of  offsets 
to  win  the  needed 
political  support 
as  a  form  of  com¬ 
mercial  policy." 


Provide  Alternative 
Financing 

Political  leaders  in 
a  nation  may  see  the 
need  for  foreign-made 
defense  items  for 
their  country,  but 
may  feel  constrained 
due  to  an  imbalance 


in  their  country’s  Balance  of  Pay¬ 
ments.  Specifically,  the  nation  may 
already  have  a  severe  deficit  in  its 
trade  balance,  and  the  purchase  of  the 
foreign-made  defense  equipment 
would  only  aggravate  the  deficit. 
Therefore,  there  might  be  an  eco¬ 
nomic,  as  well  as  a  political,  barrier  to 
the  purchase.  Once  again,  offsets  may 
provide  a  solution  for  the  policymakers’ 
dilemma. 


By  requiring,  in  the  accompanying 
offset  agreement,  the  selling  firm  to  pur¬ 
chase  an  equal  monetary  value  of  do¬ 
mestic  goods  and  services,  the  buying 
nation  can  avoid  worsening  its  trade  im¬ 
balance,  and,  in  a  fixed  exchange  rate 


regime,  protect  the  nation’s  foreign  ex¬ 
change  reserves.  Here,  the  use  of  offsets 
seems  to  approximate  a  sophisticated 
form  of  barter.  The  goods  and  services 
are  exchanged  with  no  net  effect  on  the 
currency  balances  of  the  two  countries. 

There  is  an  interesting  extension  to 
this  line  of  reasoning  for  the  use  of  off¬ 
sets  when  we  introduce  the  connection 
to  barter.  Occasionally  there  have  been 
media  reports  of  the  use  of  sophisticated 
barter  arrangements  to  conceal  the 
prices  of  exports.  This  is  most  applicable 
when  the  nation  is  a  member  of  a  car- 
tel-like  organization  such  as  Organiza¬ 
tion  of  Petroleum  Exporting  Countries 
(OPEC),  or  possibly  the  International 
Coffee  Agreement.  The  scenario  has  the 
buying  nation  knowingly  purchasing  the 
foreign-made  items  at  inflated  prices, 
and  in  return,  selling  the  oil,  coffee,  or 
whatever,  at  the  official,  cartel  approved 
price.  In  this  manner,  the  country’s  lead¬ 
ers  have  effectively  cut  the  price  of  the 
commodities  without  openly  breaking 
with  the  other  members  of  the  cartel.7 

Gain  Political  Support 

In  an  effort  to  win  domestic  support  for 
a  large  defense-related  purchase  from  a 
foreign  firm,  the  buying  government  may 
tout  the  many  benefits  the  nation  will  en¬ 
joy  from  the  offsets  received.  By  publi¬ 
cizing  the  increase  in  exports  and  associ¬ 
ated  employment  gains,  as  well  as  any  new 
capital  investments,  co-production  ar¬ 
rangements  and  technology  transfers, 
political  leaders  in  the  purchasing  nation 
will  hopefully  dampen  domestic  criticism 
of  the  purchase. 

Policymakers  in  the  buying  country 
may  see  the  use  of  offsets  to  win  the 
needed  political  support  as  a  form  of 
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commercial  policy.  Here  they  are  inter¬ 
vening  to  correct  for  an  externality;  the 
defense  items  have  a  social  value  greater 
than  the  perceived  market  value. 

Conclusion 


Transactions  involving  large  defense 
purchases  from  U.S.  firms  by  foreign 
governments  most  often  involve  offset 
agreements  between  the  selling  firms  and 
the  buying  governments.  Policymakers 
in  the  buying  nations  can  use  the  offset 
agreements  to  address  a  variety  of  eco¬ 
nomic  and  political  issues  within  the 
buying  countries.  The  desired  effects 
identified  were:  labor  market  correc¬ 
tions,  promotion  of  capital  investment, 
support  for  strategic  industries,  adjust¬ 
ments  for  asymmetric  information,  re¬ 
duction  of  risk  and  uncertainty,  alterna¬ 
tive  sources  of  financing,  and  political 


support  for  defense  purchases.  In  some 
of  these  situations,  the  use  of  offsets  ap¬ 
pears  to  be  an  alternative  form  of  com¬ 
mercial  policy,  replacing  a  more  direct 
form  of  intervention. 

Recently  provided  information  from 
industry  appears  to  validate  the  work 
done  in  the  1980s.  The  changes  in  the 
defense  environment  over  the  past  two 
decades  do  not  seem  to  have  changed 
the  motives  behind  the  use  of  offsets. 
However,  according  to  comments  from 
industry  officials,  the  frequency  of  the 
use  of  offsets,  as  well  as  the  size  of  the 
offset  requirements  (as  a  percentage  of 
the  transaction  value)  both  appear  to 
have  risen.  Offsets  are  a  reality  of  the 
existing  competitive  nature  of  the  mar¬ 
ketplace.  Understanding  the  economic 
incentives  leading  to  their  use  is  help¬ 
ful  not  only  to  U.S.  policymakers  but 
also  to  industry  officials. 
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Endnotes 


1.  See,  for  example,  “Why  Offsets?” 
Program  Manager,  November- 
December  1989. 

2.  The  majority  of  my  updated  informa¬ 
tion  came  from  an  industry  official 
who  has  worked  offset  programs  in 
over  ten  countries  over  the  past 
decade. 

3.  An  example  of  such  a  policy  is 
Australia’s  requirement  for  foreign  in¬ 
formation  technology-related  compa¬ 
nies  wishing  to  supply  information 
and  communication  technology  goods 
and  services  to  the  Government  of 
Australia  to  export  Australian  goods 
and  services,  to  transfer  technology, 
and  to  engage  in  research  and  devel¬ 
opment  in  Australia.  See,  for  example, 
2001  Country  Reports  on  Economic 
Policy  and  Trade  Practices,  published 
by  the  Bureau  of  Economic  and  Busi¬ 
ness  Affairs,  U.S.  Department  of 
State,  February  2002. 

4.  While  foreign  governments  often  have 
laws  or  policy  statements  outlining 
their  offset  expectations,  the  U.S. 
Government’s  policy,  as  stated  in  Fed¬ 
eral  Acquisition  Regulation  (FAR) 
225.7303,  is  that  the  Department  of 
Defense  does  not  get  involved  with  a 


defense  firm’s  offset  commitments. 
The  decision  to  engage  in  offsets,  and 
the  responsibility  for  fulfilling  offset 
commitments,  is  purely  the  firm’s. 

5.  The  pricing  guidelines  for  Foreign 
Military  Sales  contracts  in  FAR 
225.7303-2  support  this  assumption. 

6.  A  hypothetical  example  of  this  might 
be  where  a  U.S.  defense  firm,  as  part 
of  its  offset  commitment  to  a  buyer, 
builds  a  plant  in  a  buyer’s  country  to 
manufacture  some  parts  for  final  as¬ 
sembly  back  in  the  U.S.  or  in  some 
third  country.  The  newly  built  plant, 
however,  requires  very  specialized 
components,  machinery,  and  techno¬ 
logical  assistance,  all  of  which  must 
be  provided  by  the  defense  firm’s  pri¬ 
mary  facilities  back  in  the  United 
States. 

7.  For  examples  of  OPEC’s  use  of  bar¬ 
ter-type  transactions  during  the  mid- 
1980s  see:  Youssef  M.  Ibrahim, 
“Crumbling  Cartel  OPEC’s  Old  Iron 
Grip  on  World  Oil  Prices  becomes 
Ever  Weaker,”  The  Wall  Street  Jour¬ 
nal,  January  11,  1985,  pp.  1,  9;  and, 
“Oil-for-Planes  Accord  Is  Likely  for 
UAE,  France,”  The  Wall  Street  Journal, 
October  1, 1984,  p.  37. 
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TUTORIAL 


THE  TRANSFORMATION  OF 
CONTRACT  INCENTIVE  STRUCTURES 

Robert  Graham 

The  National  Polar-orbiting  Operational  Environmental  Satellite  System’s 
Acquisition  and  Operations  contract  for  the  next  generation  of  weather  satellites 
uses  innovative  incentive  structures  to  motivate  contractor  performance.  The 
incentive  approach  combines  an  award  fee  and  mission  success  fee 
arrangement  to  include  a  cost  mitigation  approach,  putting  fee  at  risk  and 
tying  corporate  executive  pay  to  contract  performance.  This  business  approach 
is  complemented  by  a  shared  ownership  approach  to  the  development  and 
production  of  the  satellites.  These  innovative  approaches  give  the  government 
the  flexibility  to  share  system  responsibility  while  motivating  the  contractor 
toward  outstanding  performance  on  the  contract. 


In  the  current  acquisition  environment 
of  transforming  from  traditional  to 
streamline  acquisition  approaches,  there 
are  many  innovative  strategies  being  pro¬ 
posed  by  organizations  to  incentivize  con¬ 
tractor  performance.  The  following  discus¬ 
sion  will  look  at  the  program  approach  and 
contract  incentive  structure  for  the  National 
Polar-orbiting  Operational  Environmental 
Satellite  System  (NPOESS)  program’s  Ac¬ 
quisition  and  Operations  (A&O)  contract. 
Figure  1  is  a  graphic  representation  of  the 
NPOESS  satellite  system. 

The  A&O  contract  uses  a  dual  ap¬ 
proach,  a  Shared  System  Performance 
Responsibility  (SSPR)  approach  to  the 
program  with  an  incentive  structure  that 
combines  an  award  fee  and  mission  suc¬ 
cess  fee  arrangement  to  include  a  cost 
mitigation  approach,  putting  fee  at  risk 


and  tying  corporate  executive  pay  to 
contract  performance.  The  clauses  on 
contract  and  the  comprehensive  Award 
Fee  and  Mission  Success  Fee  Plan  allow 
for  the  contractor  to  receive  interim 
award  fee  payments  while  working  to¬ 
ward  the  full  incentive  fee.  This  innova¬ 
tive  approach  gives  the  government  the 
flexibility  to  share  system  responsibility 
while  motivating  the  contractor  toward 
outstanding  performance  on  the  contract. 

Programmatics 


The  NPOESS  program  is  a  presiden- 
tially-directed  tri-agency  program  chartered 
to  converge  the  separate  Commerce,  De¬ 
fense,  and  National  Aeronautics  and  Space 
Administration  (NASA)  environmental 
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Department  of  Commerce,  through  National  Oceanic  and  Atmospheric  Administration  (NOAA), 
will  have  lead  agency  responsibility  for  the  converged  system.  The  Department  of  Commerce 
(DOC)  will  report  to  a  tri-agency  executive  committee.  NOAA  will  provide  the  System  Program 
Director  and  an  Integrated  Program  Office  (IPO). 

National  Aeronautics  and  Space  Administration  (NASA)  will  have  lead  agency  responsibility  to 
support  the  IPO  in  facilitating  the  development  and  insertion  of  new  cost  effective  technologies 
that  enhance  the  ability  of  the  converged  system  to  meet  its  operational  requirements. 

Department  of  Defense  will  have  lead  agency  responsibility  to  support  the  IPO  in  major  system 
acquisitions  necessary  to  the  National  Polar-orbiting  Operational  Environmental  Satellite  System 
(NPOESS)  program. 


Figure  2.  Tri-Agency  Relationship 


236 


The  Transformation  of  Contract  Incentive  Structures 


the  successful  development,  production, 
and  launch  of  these  satellites.  The 
NPOESS  program  integrates  the  capa¬ 
bilities  and  products  provided  by  the 
DOC  Polar-orbiting  Operational  Environ¬ 
mental  Satellite  (POES)  Program,  the 
DoD  Defense  Meteorological  Satellite 
Program  (DMSP),  and  the  NASA  long¬ 
term  continuous  climate  record 
collection.  This  single  converged  system 
will  satisfy  the  needs  of  defense,  civil, 
commercial,  and  the  scientific  communities. 

The  program  ended  a  Preliminary 
Design  Risk  Reduction  (PDRR)  phase 
with  the  award  of  the  A&O  contract.  In 
addition,  the  NPOESS  Integrated  Program 
Office  (IPO)  conducted  a  Phase  0  devel¬ 
opment  from  early  1995  through  Decem¬ 
ber  1999  and  has  had  a  series  of  ongoing 
sensor  development  programs  that  started 
in  1997.  The  Phase  0  development  and 
PDRR  phases  competitively  awarded  con¬ 
tracts  for  state-of-the-art  sensor  technol¬ 
ogy  that  would  be  used  on  the  NPOESS 
satellite.  The  PDRR  contractors  were  com¬ 
petitively  down-selected  to  one  contrac¬ 
tor  for  completion  of  the  engineering  and 
development  effort  for  each  sensor.  These 
sensor  contracts  were  subsumed  as  sub¬ 
contracts  by  the  A&O  contract  with  a 
single  prime  contractor  having  overall 
system  performance  responsibility. 

The  Phase  0  development  efforts  were 
mainly  cost-type  risk  reductions,  and  the 
PDRR  contracts  were  a  mix  of  fixed-price 
and  cost-incentive  line  items  accounting 
for  the  complexities  and  uncertainties  of 
these  efforts,  which  were  not  conducive 
to  pre-negotiated-objective  incentives. 
The  program’s  award  fee  instrument  for 
the  PDRR  efforts  provides  a  level  of  flex¬ 
ibility  and  oversight,  which  is  desirable 
given  the  developmental  characteristics 


of  these  acquisitions.  Furthermore,  the 
award  fee  process  was  established  to  have 
a  significant  impact  toward  motivating  the 
contractor  to  perform  exceptionally.  All 
of  these  efforts  were  designed  to  reduce 
development  risk  during  Engineering, 
Manufacturing,  and  Development  (EMD). 
These  efforts  culminated  with  the  comple¬ 
tion  of  the  Preliminary  Design  Review 
(PDR)  for  both  satellite  PDRR  contracts 
and  award  of  a  single  A&O  contract. 


The  NPOESS  A&O  contract  has  two 
unique  features  that  bring  substantial  in¬ 
novation  to  the  acquisition  process:  (1) 
an  innovative  award  fee  plan  that  includes 
mission  success  fee  arrangements,  and  (2) 
Shared  System  Performance  Responsibili¬ 
ties.  The  EMD  portion  of  the  contract  has 
a  Cost-Plus-Award-Fee  (CPAF)  arrange¬ 
ment  with  base  fee,  award  fees,  and  mis¬ 
sion  success  fees;  and  § 
the  production  portion 
has  a  Fixed-Price-Incen¬ 
tive  (firm  target)  (FPIF) 
arrangement  with  award 
fees  and  mission  success 
fees.  These  contract 
types  were  selected 
based  on  analysis  of  pro¬ 
gram  risks. 

Three  types  of  fees  l; 
exist  in  the  EMD  Phase.  They  are  a  base 
fee  (2  percent  of  the  estimated  cost), 
an  award  fee  (13  percent  of  the  esti¬ 
mated  cost),  and  a  mission  success  fee 
(5  percent  of  the  estimated  cost). 
Whereas,  in  an  FPIF  arrangement,  used 
in  the  production  phase,  there  is  a  tar¬ 
get  profit  at  10  percent  of  target  cost  of 


Contractual  Overview 


"This  single 

NPOESS  will 
satisfy  the  needs 
•f  defense,  chril, 
commercial,  and 
the  scientific 
communities." 
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each  replenishment  satellite,  a  50-50-share 
ratio  for  overruns  and  underruns,  and  a 
ceiling  price  of  135  percent  of  target  cost, 
award  fee  (5  percent  of  target  cost),  and 
mission  success  fee  (5  percent  of  target 
cost). 

The  base  fee  under  the  EMD  phase  will 
be  used  to  help  the  contractor  provide 
some  cash  flow  stability.  The  award  fee 
for  both  the  EMD  phase  and  production 
efforts  of  the  contract  is  intended  to 
incentivize  continuous  contractor  respon¬ 
siveness  to  program  priorities  and  place 
emphasis  on  quality  processes. 

The  mission  success  fee  criteria  has  been 
developed  to  reward  the  contractor  for 
achieving  specific,  demonstrable  program 
objectives  that  are  critical  program  events 
during  the  EMD  phase 
of  the  contract,  while  the 
mission  success  fee  cri¬ 
teria  developed  for  the 
production  FPIF  in¬ 
centive  will  incentivize 
the  contractor  to  meet 
cost  targets  and  specific 
program  events. 

Finally,  a  fee  risk  cov¬ 
enant  clause  is  included  in  the  contract. 
All  the  fee  or  profit  earned  in  the  EMD 
phase  and  production  efforts  is  earned  at 
risk.  That  is,  fee  is  earned  by  and  paid  to 
the  contractor  during  contract  performance, 
but  the  government  may  recoup  some  fee/ 
profit  if  the  system  (for  the  EMD  effort)  or 
the  replenishment  satellites  (for  the  pro¬ 
duction  effort)  do  not  meet  performance 
goals. 

The  A&O  contract  also  has  unique 
incentive  clauses  to  address  the  following 
areas: 


'KUI  Hi*  fee  or 
profit  •anted  in 
the  EMD  phase  and 

pwwciwn  vi  i  vi 
is  earned  at  risk." 


1.  Shared  System  Performance  Re¬ 
sponsibility  (SSPR).  The  prime  con¬ 
tractor  is  responsible  for  SSPR  and 
undertaking  all  actions  necessary  for 
ensuring  that  the  overall  perfor¬ 
mance  of  the  NPOESS  satellites 
meets  all  requirements  as  described 
in  the  A&O  contract.  This  concept 
will  be  discussed  in  depth  below. 

2.  Cost  Mitigation  Incentive.  A  cost 
mitigation  incentive  is  used  to  encour¬ 
age  the  contractor  to  prepare  and 
apply  cost  mitigation  initiatives.  The 
contract  allows  the  contractor  to 
submit  cost  mitigation  incentive  pro¬ 
posals  for  the  government’s  review 
and  acceptance.  Where  an  initiative 
results  in  real  savings  to  the  contract, 
the  savings  are  shared  between  the 
parties. 

For  each  production  option  on  con¬ 
tract,  the  contractor  proposed  a  firm 
target  price,  and  the  government  will 
have  the  unilateral  right  to  exercise  the 
option  at  that  price,  at  the  appointed 
time.  However,  since  this  price  will 
likely  include  some  factor  for  risk  that 
might  not  materialize  by  the  time  the 
option  is  exercised,  the  government 
wanted  to  incentivize  the  contractor  to 
manage  and  reduce  the  risk  to  the  gov¬ 
ernment  with  an  expectation  of  rene¬ 
gotiating  a  lower  target  price  as  rea¬ 
sonable.  The  cost  mitigation  concept 
is  an  improvement  over  value  engi¬ 
neering  for  this  program  by  giving 
better  insight  on  acquisition  savings 
and  collateral  savings  than  proposed 
by  Federal  Acquisition  Regulation 
(FAR)  48.  This  incentive  structure  will 
be  discussed  in  depth. 
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3.  Fee  Risk  Covenant  Although  the  con¬ 
tractor  may  earn  fee  during  the  course 
of  this  contract,  the  award  fees  and  mis¬ 
sion  success  fees  earned  during  the 
EMD  phase  of  the  contract  are  earned 
at  risk.  Similarly,  the  fixed-price-incen¬ 
tive  profit  (or  fee),  award  fees,  and  mis¬ 
sion  success  fees  earned  during  the  pro¬ 
duction  efforts  on  each  replenishment 
satellite  are  also  earned  at  risk.  This 
means  that  although  the  contractor  has 
possession  and  use  of  earned  fee,  to 
retain  possession  of  the  fee  it  must  pro¬ 
duce  a  system  that  provides  useful  ser¬ 
vice  over  the  satellite’s  life.  This  incen¬ 
tive  structure  will  be  discussed  below. 

4.  Performance  Inputs  to  Senior  Ex¬ 
ecutive  Compensation.  This  clause 
is  an  effort  to  decrease  cost  overruns 
on  major  contracts,  “which  typically 
run  18  percent  over  budget  —  costs 
that  the  Defense  Department  pays 
for”  (Merle,  2002,  p.  E5).  This  con¬ 
tract  is  the  first  to  use  this  new  Air  Force 
initiative.  “The  provision  in  the  con¬ 
tract  won’t  force  executives  to  take 
a  pay  cut,  but  requires  TRW’s 
(aquired  by  Northrop  Grumman  on 
December  12,  2002)  board  to  consider 
contract  performance  when  setting  top 
executives’  salaries  and  bonuses” 
(Merle,  2002,  p.  E5).  In  essence,  the 
clause  in  the  NPOESS  A&O  contract 
would  require  TRW  to  present  to  the 
corporate  board  on  a  semi-annual 
basis  information  about  Northrop 
Grumman’s  performance  on  the 
NPOESS  A&O  contract.  According 
to  the  Washington  Post,  “the  Air 
Force  is  the  only  part  of  the  Pentagon 
to  propose  linking  performance  to  ex¬ 
ecutive  pay”  (Merle,  2002,  p.  E5). 


This  innovative  clause  is  one  part 
of  the  incentive  structure  of  the 
NPOESS  A&O  contract  aimed  at 
increasing  the  contractor’s  account¬ 
ability  for  contract  performance. 

5.  Base  Fee.  A  special  clause  under 
section  B  includes  a  provision  of  a 
base  fee  as  an  incentive  to  the  con¬ 
tractor.  The  contractor  may  invoice 
monthly  for  an  amount  equal  to  one 
twelfth  of  that  fiscal  year’s  base  fee 
amount. 


Shared  System  Performance 
Responsibility 


The  key  to  the  successful  business, 
programmatic,  and  contractual  relation¬ 
ship  under  the  NPOESS  A&O  contract 
is  SSPR.  The  innovative  concept  and  the 
centerpiece  to  the  A&O  contract  is  the 
SSPR  clause.  The  SSPR 
clause  states  for  perfor¬ 
mance  responsibility, 

“The  contractor  shall 
have  SSPR  for  the  en¬ 
tire  NPOESS  (NPOESS 
A&O  Contract,  2002).” 

SSPR  means  that  the 
contractor  is  respon¬ 
sible  for  undertaking 
any  and  all  actions  nec¬ 
essary  for  ensuring  that 
the  overall  performance 
of  NPOESS  meets  all 
contract  requirements. 

SSPR  includes  integration  of  all  seg¬ 
ments,  systems,  subsystems,  and  com¬ 
ponents  whether  furnished  by  the 
government,  identified  and  directed  by  the 
government,  managed  by  the  government 


"Thekey  to 
the  successful 
business,  program¬ 
matic,  and  contrac¬ 
tual  relationship 
under  the  NPOESS 
A&O  contract  ti';’-- 
Shared  System 
Performance 
Responsibility." 


Fnr  KPOF.S.C 
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or  its  designated  agent,  or  commercially 
acquired.  Additionally,  the  contractor  is 
responsible  for  ensuring  that  the 
NPOESS  [satellite]  is  optimized  for  post- 
EMD  production,  deployment,  and  sup¬ 
port  (NPOESS  A&O  Contract,  August 

22,  2002,  p.  28). 1 

Integration  responsibility  under  SSPR 
includes  the  monitoring  of  all  associate 
contractor  and  government  systems  and 
infrastructure  activities.  Monitoring  in¬ 
cludes  the  timely  notification  and  rec¬ 
ommendation  of  mitigation  efforts  to  the 
government  for  risks  resulting  from 
schedule,  technical,  or  resource  conflicts 
with  these  systems  and  infrastructure  ac¬ 
tivities  to  ensure  the  contract  schedule, 
NPOESS  system  specification,  and  inte¬ 
grated  master  plan  requirements  are  met 
by  the  contractor.  Under  the  SSPR  clause: 

The  contractor  accepts  perfor¬ 
mance  responsibility  whether  or  not 
individual  segments,  systems,  sub¬ 
systems,  or  components  are  fabri¬ 
cated,  manufactured,  or  assembled 
by  the  contractor,  a  subcontractor 
(notwithstanding  that  any  such  sub¬ 
contractor  may  have  been  selected 
pursuant  to  any  provision  hereof), 
or  furnished  as  government-fur¬ 
nished  property  (GFP).  (NPOESS 
A&O  Contract,  August  22,  2002, 

p.  28) 

The  contractor  is  fully  responsible  for 
the  integration  of  all  systems,  sub¬ 
systems,  and  components  whether  GFP 
or  commercially  acquired,  installed  and 
integrated  into  the  NPOESS  system  with¬ 
out  any  degradation  of  performance  of 
that  item  or  in  the  overall  system  perfor¬ 
mance,  and  all  required  inspection  and 


acceptance  test  procedures  are  accom¬ 
plished  and  sufficient  to  meet  specifica¬ 
tions  and  performance  requirements.  The 
contractor’s  responsibility  to  install  and 
integrate  subsystems  and  components 
without  degradation  of  performance  is 
in  addition  to,  and  not  in  substitution  of, 
its  responsibility  to  insure  that  the  total 
system  will  meet  all  requirements  of  the 
system  specification. 

The  SSPR  clause  also  includes  provi¬ 
sions  for  an  equitable  adjustment  if  fail¬ 
ures  of  any  external  systems  or  infra¬ 
structure  requiring  interface  with  the 
NPOESS  satellite  does  not  meet  stated 
capabilities.  This  does  not  relieve  the 
contractor  of  SSPR,  as  the  contractor  is 
required  under  the  contract  to  avoid  or 
mitigate  any  impacts  to  the  NPOESS  sat¬ 
ellite  to  the  maximum  extent  practicable. 
However,  the  SSPR  clause  does  state: 

The  parties  agree  that  equitable  ad¬ 
justments  may  be  made  to  the  cost, 
schedule,  NPOESS  contract  system 
specification,  fee  criteria  and  other 
affected  terms  and  conditions  of  the 
NPOESS  contract  for  NPOESS 
impacts  resulting  from  changes  to 
external  systems  or  infrastructures 
requiring  interface  with  NPOESS 
capabilities.  (NPOESS  A&O  Con¬ 
tract,  August  22,  2002,  p.28) 

The  basic  concept  of  total  system 
performance  responsibility  is  met 
through  a  shared  ownership  approach. 
SSPR  does  not  eliminate  government 
oversight  of  key  important  parameters, 
or  cost  and  schedule  issues.  The  gov¬ 
ernment  continues  to  have  successful 
insight  into  the  contractor’s  operations 
while  maintaining  the  critical  oversight 
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of  program  issues.  The  innovation  of  understanding  of  program  business 

SSPR,  having  open  communication  to  risks,  awareness  of  industrial  base 

facilitate  insight  into  the  program’s  de-  concerns,  and  shared  ownership, 

cision  making,  and  an  integrated  manage-  Even  with  award  of  the  NPOESS 

ment  framework  to  improve  visibility,  has  A&O  contract,  these  three  prin- 

reengineered  how  the  government  views  ciples  will  continue  to  exist  and  shall 

total  system  performance  responsibil-  be  encompassed  by  the  concept  of 

ity.  The  NPOESS  programmatic  and  shared  ownership.  Shared  owner- 

business  arrangement  adapts  to  the  ship  is  defined  as  the  integrated 

changing  acquisition  environment  and  management  framework  between 

institutes  SSPR  as  a  means  of  estab-  the  IPO  and  SSPR  contractor  that 

lishing  a  government  and  contractor  provides  the  foundation  for  program 

partnership  that  reflects  the  government’s  performance  consistent  with  these 

expectations  with  significant  incen-  principles  and  the  requirements  of 

tives  focused  on  the  highest  program  this  contract.  (NPOESS  A&O  Con- 

risks  to  create  a  win-win  situation.  tract,  August  22,  2002,  p.  29) 

The  program  office  and  the  contractor 
Shared  Ownership  Clause  work  together  under  the  basis  of  the  clause 

to  ensure  teamwork,  trust,  open  communi- 
The  contractor  accepts  SSPR  through  cations,  and  consultation  with  each  other 
the  life  of  the  contract.  To  complement  on  program  decisions  that  impact  the  team’s 

the  SSPR  clause2  is  a  shared  ownership  ability  to  execute  the  program.  The  clause 

clause  that  defines  the  SSPR  relationship  states  that: 
more  fully. 

With  the  relationship  under  the  SSPR  Contractor  performance  will  be 

clause  established  above,  the  NPOESS  evaluated  against  the  obligations  set 

program  office  and  the  contractor  have  forth  in  this  contract  including 

adopted  the  concept  of  shared  ownership  modifications  to  this  contract. 

—  a  relationship  between  government  and  Award  fee  or  incentive  fee  evalua- 

industry  where  risk  and  returns  are  shared.  tions  will  be  made  in  accordance 

This  management  approach  depends  with  the  provisions  of  the  contract, 

upon  highly  integrated  management  The  IPO  will  conduct  evaluations 

teams  to  ensure  adequate  government  that  reflect  the  effect  of  the 

insight  and  oversight  while  maintaining  government’s  actions  on  the  per- 

SSPR  by  industry.  This  partnership  is  formance  of  the  integrated  manage- 

implemented  through  a  shared  ownership  ment  team.  (NPOESS  A&O  Con- 

clause.  The  shared  ownership  clause  tract,  August  22,  2002,  p.  29) 

states: 

To  facilitate  the  shared  ownership  con- 
The  foundation  of  the  NPOESS  cept  through  the  life  of  the  A&O  contract, 

acquisition  strategy  is  based  on  the  program  office  and  contractor  will 

three  guiding  principles:  a  solid  engage  in  a  quarterly  dialogue. 
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The  purpose  of  this  dialogue  is  to 
maintain  executive  focus  on  program 
performance  and  evaluate  the  IPO  and 
contractor  team’s  effectiveness  in 
achieving  the  desired  program  results. 
At  the  close  of  each  government  fiscal 
year  quarter,  the  IPO  and  contractor  pro¬ 
gram  directors  jointly  prepare  an  agenda 
for  executive  dialogue  to  be  conducted 
by  their  respective  executives  (NPOESS 
A&O  Contract,  2002,  p.  29). 

The  A&O  contract  has  the  highest  vis¬ 
ibility  within  the  contractor’s  organiza¬ 
tion  to  facilitate  these  discussions  and  re¬ 


lationships.  As  mentioned  above,  there 
is  also  executive  pay  tied  to  the  success¬ 
ful  contractor  perfor¬ 
mance.  This  total  pack- 
IHotg  the  age  of  incentives  assists 

•wnenhip  with  the  complete  un- 

through  derstanding  of  the 

•f  the  A&O  SSPR  concept  under 

I,  the  pro-  the  NPOESS  A&O  con- 


"To  facilitate  the 
shared  ownership 
concept  through 
the  life  of  the  A&O 
contract,  the  pro¬ 
gram  office  and 
contractor  will 
engage  in  a  quar¬ 
terly  dialogue." 


or  win  jn  addition,  there  are 

inaquar-  Integrated  Product 

■logue."  Team  ^IpT^  relation_ 

ships  addressed  under 

the  concept  of  shared 
ownership.  Under  the  shared  ownership 
clause,  “The  contractor  shall  invite  the 
IPO  to  assign  government  officials  (or 
supporting  Federally  Funded  Research 
and  Development  Center  [FFRDC]  em¬ 
ployees)  on  the  contractor’s  IPTs.  The 
IPO  may  or  may  not  make  such  assign¬ 
ments  (NPOESS  A&O  Contract,  August 
22,  2002,  p.  29).”  Where  these  assign¬ 
ments  are  made,  they  are  for  the  pur¬ 
pose  of  providing  visibility  into  the 
contractor’s  performance  and  progress, 
and  insight  to  the  contractor  from  the 
government.  The  clause  goes  on  to  say, 


[Government  officials  (or  sup¬ 
porting  FFRDC  employees)  do  not 
chair  IPTs,  and  the  presence  and 
participation  of  government  offi¬ 
cials  on  an  IPT  does  not  indicate 
government  acceptance  or  concur¬ 
rence  on  any  matter  presented  to 
the  IPT.  Government  participation 
does  not  in  any  way  relieve  the 
contractor  of  responsibility  for  to¬ 
tal  system  performance  under  this 
contract.  (NPOESS  A&O  Contract, 
August  22,  2002,  p.  29) 

[Also,  the]  Contracting  officer  shall 
be  the  only  individual  authorized 
to  redirect  the  effort  or  in  any  way 
modify  any  terms  of  this  contract. 

The  contractor  shall  not  rely  on  any 
direction  or  instruction  from  any 
other  government  team  member 
that  is  contrary  to  the  contract  or 
that  increases  or  decreases  the 
scope  or  estimated  cost  of  the  con¬ 
tract.  Insight  and  information  pro¬ 
vided  to  the  contractor  by  other 
members  of  the  government  team 
is  provided  for  the  contractor’s  ben¬ 
efit  and  use  as  it  sees  fit  to  accom¬ 
plish  its  total  system  performance 
responsibilities  under  this  contract. 
(NPOESS  A&O  Contract,  August 
22,  2002,  p.  29) 

The  NPOESS  program  provides  an  op¬ 
portunity  to  redefine  how  government  and 
industry  cooperate  to  procure  and  deliver 
goods  and  services.  Shared  ownership  of¬ 
fers  the  potential  to  harness  the  efficiency 
of  commercial  practices  to  significantly 
reduce  the  cost  of  major  system  acquisi¬ 
tions.  The  basis  of  shared  ownership,  as 
stated  above,  allows  IPO  participation  in 
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IPTs  for  visibility  and  insight  into  the 
contractor’s  performance  and  progress. 
However,  this  participation  does  not  relieve 
the  contractor  of  overall  system  perfor¬ 
mance.  In  an  effort  to  promote  better  man¬ 
agement  of  this  tri-agency  program,  in  con¬ 
junction  with  motivating  the  contractor’s 
performance,  the  concept  of  SSPR  and 
shared  ownership  was  developed  to  im¬ 
prove  communication  between  the  con¬ 
tractor  and  the  government.  This  improved 
management  concept  will  assist  in  man¬ 
aging  the  design  and  production  of  the  next 
generation  weather  satellites. 


Innovative  Award  Fee  Rian3 


Interim  Award  Fee  Payment 
and  Adjustment 

There  are  three  areas  that  encompass 
award  fee:  (1)  interim  award  fee  payments, 
(2)  mission  success  incentives,  and  (3)  fee 
at  risk.  Ancillary  to  this  incentive  structure 
is  a  cost  mitigation  incentive  that  is  also 
key  to  motivating  the  contractor  to  reduce 
costs.  For  the  interim  award  fee  payments, 
the  government  may  make  monthly  interim 
award  fee  payments  to  the  contractor. 
These  fee  payments  shall  not  exceed  80 
percent  of  the  award  fee  amount  available 
for  each  evaluation  period,  and  are  prorated 
on  a  monthly  basis.  The  determination  and 
the  methodology  for  determining  the 
amount  of  award  fee  billable  are  unilateral 
decisions  made  solely  at  the  discretion  of 
the  government  based  on  contractor  per¬ 
formance.  Adjustment  of  the  interim  award 
fee  payments,  to  reflect  and  account  for 
the  actual  award  fee  earned  and  awarded 
for  the  evaluation  period,  has  an  elaborate 
mechanism  for  fairness  of  the  award  fee 
process.4 


"fljhegovem- 
ment  may  make 
monthly  interim 
award  fee  pay¬ 
ments  to  the 

n  \.’v££ 


If  the  cumulative  amount  of  interim 
award  fee  payments  made  during  an  evalu¬ 
ation  period  is  less  than  the  total  award  fee 
determined  to  have  been  earned  or  awarded 
for  that  period,  the  contractor  is  required 
to  submit  a  separate  invoice  for  the  addi¬ 
tional  amount  and  the  government  will  pay 
the  balance  of  the  award  fee  earned  under 
the  terms  of  the  award  fee  clause.5 

If,  for  any  reason,  the  cumulative 
amount  of  interim  award  fee  payments 

made  during  an  evalua-  5 . 

tion  period  exceeds  the  I 
total  award  fee  deter¬ 
mined  by  the  government 
to  have  been  earned  or 
awarded  for  that  period, 
the  government  shall  de¬ 
duct  or  offset  the  overpay-  \ 
ment  from  subsequent  fee 
and,  if  necessary,  costs  in-  | 
curred.  To  assist  the  government  in  this 
regard,  the  contractor  is  required  to  reflect 
such  adjustments  on  subsequent  invoices. 
For  purposes  of  FAR  clause  52.232-17, 
interest,  the  due  date  for  any  refund  to  be 
made  by  the  contractor  is  the  date  of  the 
first  written  demand  for  payment.  This  in¬ 
terim  award  fee  payment  process  comple¬ 
ments  the  incentive  fee  arrangement  on 
contract. 

Industry  stressed  the  importance  of  two 
financial  elements  when  developing  the 
strategy  for  the  A&O  contract:  profit  and 
cash  flow.  Several  contracts  within  the  Air 
Force  have  used  the  interim  award  fee 
payments  to  improve  the  contractor’s  cash 
flow,  foster  a  healthy  relationship  between 
the  government  and  industry,  and  further 
the  benefits  of  the  award  fee  incentive. 
The  intent  of  the  interim  award  fee  pay¬ 
ment  business  arrangement  was  to  moti¬ 
vate  contractors  to  perform  well  and  gain 
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momentum  in  the  initial  award  fee  pe¬ 
riod,  allow  heightened  responsiveness 
to  program  areas  of  interest  and  con¬ 
cern,  provide  contractors  with  reason¬ 
able  cash  flow  on  a  major  systems  ac¬ 
quisition,  and  leverage  the  overall 
award  fee  period  incentive  in  terms  of 
avoidance  of  the  contractor  having  to 
repay  the  interim  award  fee  with  inter¬ 
est.  This  incentive  seeks  to  motivate 
the  contractor  to  effectively  make  busi¬ 
ness  decisions,  facilitate  communica¬ 
tion  at  all  levels  within  the  program, 
and  promote  flexibil¬ 
ity  in  the  contractor’s 
internal  incentive  pro¬ 
grams.  The  incentive 
looks  to  heightened 
awareness  and  re¬ 
sponsiveness  to  prob¬ 
lems,  action  plans, 
and  to  promote  team¬ 
work  within  the  inte¬ 
grated  product  teams 
making  them  more 
effective  through 
early  detection  rather 
than  reactionary  to  program  issues. 

Cash  flow  concerns  are  mitigated  by 
the  interim  payments  and  the  government 
is  fully  protected  by  the  Fee  Determining 
Official  (FDO)  oversight  of  the  process. 
The  guidelines  are  clearly  established  in 
the  award  fee  and  mission  success  fee 
plan,  and  refunds  are  required  if  perfor¬ 
mance  was  not  as  favorable  as  determined 
during  the  period. 

In  the  true  sense  of  promoting  acqui¬ 
sition  reform  within  the  acquisition  com¬ 
munity,  the  NPOESS  program  stepped 
out  with  its  initiative  to  improve  a  rec¬ 
ognized  critical  business  arrangement  by 


"The  controversy  of 
|  interim  award  fee 
payments  is  the 
I  perceived  statutory 
restrictions  that 
I  advance  payment  of 
public  monies  is 
prohibited  unless 
property  approved." 


providing  interim  award  fee  payments  on 
the  A&O  contract. 

The  controversy  of  interim  award  fee 
payments  is  the  perceived  statutory  re¬ 
strictions  that  advance  payment  of  public 
monies  is  prohibited  unless  properly  ap¬ 
proved.  This  prohibition  is  found  at  31 
United  States  Code  section  3324  that 
states,  “Except  as  provided  in  this  sec¬ 
tion,  a  payment  under  a  contract  to  pro¬ 
vide  a  service  or  deliver  an  article  for  the 
United  States  government  may  not  be 
more  than  the  value  of  the  service  already 
provided  or  the  article  already  delivered.” 
The  basic  meaning  of  the  statute  is  that  if 
the  money  has  not  been  earned,  it  cannot 
be  paid.  The  comptroller  general  has  in¬ 
terpreted  the  statutory  precursors  (Section 
3648,  Revised  Statutes,  and  31  United 
States  Code  529)  to  31  United  States  Code 
3324  as  not  preventing  a  partial  payment 
in  any  case  in  which  the  amount  of  such 
payment  has  actually  been  earned  by  the 
contractor  and  the  United  States  has  re¬ 
ceived  an  equivalent  therefore,  i.e.,  cor¬ 
responding  benefit.  (See,  1  Comptroller 
General  143,  145  [1921];  47  Comptrol¬ 
ler  General  89  [1977]). 

The  interim  award  fee  procedure  under 
the  A&O  contract  conforms  to  the  comp¬ 
troller  general  criteria  because  it  allows 
the  contractor  to  bill  periodically  for  an 
established  percentage  of  available  award 
fee  during  each  evaluation  period.  The 
point  that  the  payment  was  “actually 
earned  by  the  contractor”  is  pertinent  here. 
It  is  reasonable  to  view  award  fee  as 
earned  by  the  contractor  daily,  the  pre¬ 
cise  amount  of  which  is  not  determined 
until  the  end  of  the  period.  The  award  fee 
is  not  determined  daily,  but  over  a  greater 
period  of  time,  to  make  reasonable  ad¬ 
ministration  possible.  The  A&O  contract 
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uses  the  following  logic  for  their  interim 
award  fee  approach;  first,  the  contractor 
has  performed  and  can  therefore  be  con¬ 
sidered  to  have  earned  some  portion  of 
profit  or  fee.  Then  second,  final  pricing 
straightens  out  any  under  or  overages. 

The  interim  award  fee  payment  is  au¬ 
thorized  only  after  an  assessment  by  the 
FDO  that  the  contractor’s  performance 
warrants  interim  payments.  The  histori¬ 
cal  thinking  as  to  why  award  fee  could 
not  be  the  subject  of  some  type  of  in¬ 
terim  billing  related  to  the  need  for,  and 
finality  of  the  FDO’s  decision.  As  long 
as  the  FDO’s  ability  to  make  an  indepen¬ 
dent  decision  is  preserved  and  the  con¬ 
tractor  accepts  the  fact  that  it  might  end 
up  repaying  some  amount  based  on  the 
FDO’s  decision,  there  is  no  reason  why 
the  same  logic  as  that  supporting  interim 
billing  of  other  fees  would  not  apply. 
Any  overpayment  or  underpayment  will 
be  rectified  after  the  FDO’s  independent 
decision.  There  is  no  precedent  that 
would  make  repayment  under  the  A&O 
contract  any  more  problematic  than  cor¬ 
rection  of  an  administrative  overpay¬ 
ment  or  erroneous  payment. 

The  award  fee  and  mission  success  fee 
plan  sets  forth  the  criteria  for  interim  award 
fee  payments  as  discussed  above.  Interim 
award  fee  is  predicated  upon  contractor 
performance.  Interim  award  fee  provides 
quantifiable  time  value  of  money  advan¬ 
tages  to  the  contractor.  However,  it  should 
be  noted  that  the  NPOESS  program  uses 
the  interim  award  fee  provisions 
judiciously  with  consideration  given  for 
unusual  cash  flow  concerns  from  the 
contractor,  the  length  of  the  award  fee 
periods,  and  the  expected  benefits  to  the 
acquisition. 


In  summary,  the  NPOESS  program’s 
philosophy  holds  that  contractors  are  earn¬ 
ing  award  fee  throughout  the  award  fee 
period.  Paying  a  percentage  of  the  fee  on 
their  regular  billing  cycle  at  a  rate  that  is 
unlikely  to  result  in  overpayment  would 
not  constitute  an  advance  payment.  In  the 
unlikely,  unintended  event  the  contractor 
is  paid  at  a  rate  ultimately  determined  to 
exceed  its  entitlement;  the  difference  could 
be  recouped  as  an  overpayment  or  erro¬ 
neous  payment.  The 
award  fee  and  mission 
success  fee  plan  was 
drafted  to  maximize 
contractor  cash  flow, 
government  obligation 
rates  while  minimizing 
government  resources  of 
administration,  and  odds 
of  overpayment. 

The  interim  award  fee 
payment  helps  the  con¬ 
tractor  offset  cash  flow 
problems  associated 
with  performing  this  major  multi-billion 
dollar  program.  The  concern  about  cash 
flow  was  very  important  to  the  program 
office  based  on  input  from  industry  and 
consideration  of  other  major  satellite 
program’s  histories  of  cost  overruns.  This 
advantageous  incentive  structure  allows 
the  contractor  to  focus  more  on  achiev¬ 
ing  the  program  elements  than  cash  flow 
issues  and  payment  procedures.  By  adopt¬ 
ing  this  incentive  structure,  the  intent  was 
to  maintain  a  healthy  contractor  relation¬ 
ship  and  incentivize  the  contractor  to  fo¬ 
cus  on  contract  performance  for  develop¬ 
ing  and  producing  the  next  generation  of 
weather  satellites. 


"Cash  flow 
concerns  are 
mitigated  by  the 
interim  payments 
and  the  govern¬ 
ment  is  fully 
protected  by  the 
Fee  Determining 
Official  (FDO) 
oversight  of  the 
process." 
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Award  Fee  and  Mission  Success  Fa  Pun 
Structure 

The  comprehensive  award  fee  and 
mission  success  fee  plan  is  the  basis  for 
the  government’s  award  fee  and  mission 
success  fee  evaluation  of  the  contractor’s 
performance  under  the  A&O  contract  for 
the  EMD  phase  and  production  efforts. 
The  award  fee  and  mission  success  fee 
plan  implements  Air  Force  Materiel  Com¬ 
mand  Federal  Acquisition  Regulation 
(AFMCFARS)  clause  5352.216-9003, 
and  together  these  two  elements  apply 
significantly  new  innovation  to  this  con¬ 
tract. 

This  contract  includes  two  types  of 
incentive  fees  in  the  award  fee  and  mis¬ 
sion  success  fee  plan.  The  first  is  award 
fee.  The  second  is  the  mission  success  fee. 
Both  are  award  fee  constructions  and  the 
award  fee  and  mission  success  fee  plan 
covers  the  process  for  both  fees.  Award 
fee  incentivizes  the  contractor’s  manage¬ 
ment  approaches,  tech¬ 
nical  excellence,  and 
cost  control  efforts  on  an 
on-going,  period-by-pe¬ 
riod  basis.  Mission  suc¬ 
cess  fee  incentivizes  the 
contractor’s  realization 
of  certain  specific 
achievements  that  are 
critical  to  the  success  of 
the  program. 

The  FDO  solely  deter¬ 
mines  the  award  fee  and 
mission  success  fee 
amounts  earned.  These  incentive  structures 
give  the  government  program  director  pro¬ 
gram  flexibility  and  latitude  to  reward  re¬ 
sults  during  contract  performance.  Both 
award  fee  and  mission  success  fee  are  fur¬ 
ther  divided  between  the  development  and 


production  efforts  of  the  contract.  The 
development  effort  is  the  design,  devel¬ 
opment  and  deployment  of  the  system, 
including  operations  and  support,  through 
the  declaration  of  Initial  Operational 
Capacity  (IOC).  The  production  effort  is 
for  replenishment  satellites  for  the  program 
life.  The  award  fee  and  mission  success 
fee  earned  under  this  plan  are  earned  at 
risk  as  described  in  the  clause  for  fee  risk 
covenant  that  will  be  discussed  below. 

The  award  fee  plan  is  set  up  such  that 
there  are  two  separate  authorities  that 
authorize  payments.  The  FDO  is  the  gov¬ 
ernment  official  (for  the  NPOESS  Program 
the  FDO  is  the  program  director)  desig¬ 
nated  to  determine  the  amount  of  award 
fee  and  mission  success  fee  earned  and 
payable  to  the  contractor.  The  FDO  also 
makes  rollover  decisions.  Rollover  of  fee 
is  the  ability  of  the  FDO  to  authorize  un¬ 
earned  fee  from  the  current  fee  period, 
whether  award  fee  or  mission  success  fee, 
into  subsequent  fee  periods.  The  FDO  may 
also  authorize  interim  mission  success  fee 
payments.  In  contrast  to  the  FDO  respon¬ 
sibilities,  the  Award  Fee  Review  Board 
(AFRB)  chair  may  only  authorize  interim 
award  fee  payments  in  accordance  with 
the  “interim  award  fee  payment  and  ad¬ 
justment”  clause  and  the  award  fee  and 
mission  success  fee  plan  and  section  7  of 
the  award  fee  and  mission  success  fee 
plan. 

Determination  of  the  earned  award  fee 
and  mission  success  fee  is  inherently  sub¬ 
jective.  The  contractor’s  assessment  of  its 
own  performance,  assessments  produced 
by  government  performance  monitors, 
the  knowledge  of  the  AFRB  and  FDO, 
and  the  criteria  specified  in  the  plan  form 
the  basis  for  the  recommendations  of  the 
AFRB  and  determinations  by  the  FDO. 


"The  interim 
award  fee  pay¬ 
ment  helps  the 
contractor  offset 
cask  flow  problems 
associated  with 
performing  this 
ma|or  multi-billion 
dollar  program." 
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As  discussed  above,  the  incentive  struc¬ 
ture  is  set  up  so  the  AFRB  chair  may 
authorize  interim  payments  of  award  fee, 
but  it  is  only  the  FDO  that  may  authorize 
one  or  more  interim  payments  of  mission 
success  fee.  The  FDO  may  authorize  in¬ 
terim  mission  success  fee  payments  at  the 
one,  two,  and  three-year  points,  so  long  as 
the  cumulative  value  of  these  interim  pay¬ 
ments  do  not  exceed  the  mission  success 
incentive  percentages  shown  in  the  award 
fee  and  mission  success  fee  plan.  Interim 
mission  success  fee  payments  are  like  in¬ 
terim  award  fee  payments  and  are  subject 
to  government  recoupment  if  the  final 
FDO  fee  determination  for  the  mission  suc¬ 
cess  event  is  less  than  the  amount  autho¬ 
rized  as  interim  fee. 

The  award  fee  and  mission  success  fee 
plan  also  have  a  provision  for  rollover  of 
award  fee.  The  FDO  may  allow  rollover 
of  unearned  award  fee  into  subsequent 
award  fee  periods.  The  FDO  may  allow 
rollover  of  unearned  mission  success  fee 
into  the  following  events  or  into  new  events. 
The  purpose  of  the  interim  payments  and 
rollover  of  fees  to  subsequent  periods  is 
two-fold:  (1)  to  allow  the  contractor  the 
use  of  the  fee,  which  is  substantial  for  a 
major  satellite  program,  during  the  period, 
and  (2)  to  motivate  the  contractor’s  per¬ 
formance  by  allowing  the  contractor  the 
opportunity  to  earn  the  unused  fee  in  a 
subsequent  period  where  it  is  in  the 
government’s  best  interest  to  do  so 
based  on  program  risks  and  objectives. 
While  these  incentives  have  been  dis¬ 
cussed  and  tested  on  numerous  govern¬ 
ment  contracts,  the  incentive  structure  un¬ 
der  the  NPOESS  A&O  contract  formalizes 
the  government’s  ability  to  use  these  in¬ 
centives  to  motivate  the  contractor  on  a 
major  satellite  program. 


This  transformation  for  contract  per¬ 
formance  incentives  is  accomplished 
through  a  shift  in  how  the  organization 
processes  award  fees  and  mission  suc¬ 
cess  fees.  The  contract  performance  in¬ 
centive  transformation  seeks  to  imple¬ 
ment  a  new  concept  for  award  fee  and 
mission  success  fee  plans  by  using  the 
interim  payments  of  fees  in  conjunction 
with  having  those  fees  at  risk  to  moti¬ 
vate  performance.  The  transformation  of 
award  and  mission  success  fees  under  this 
contract  is  a  substantial  improvement  to 
the  comprehensive  and 
flexible  fee  system  for 
achieving,  sustaining, 
and  maximizing  business 
success.  The  key  con¬ 
cepts  for  the  success  of 
the  award  fee  and  mis¬ 
sion  success  plan  are:  (1) 
a  close  understanding 
and  a  clear  definition  of 
customer  needs  for  the 
contractor,  (2)  the  under¬ 
standing  of  contractor 
cash  flow  problems 
based  on  prior  history  of 
other  satellites  and  similar  satellites 
program’s  histories  through  the  review 
of  data  and  statistical  analysis  to  ensure, 
in  the  case  of  the  NPOESS  program,  the 
best  value  for  the  government  under  this 
plan,  with  (3)  diligent  attention  to  man¬ 
aging,  improving,  and  reinventing  busi¬ 
ness  practices  to  ensure  a  fair  fee  in¬ 
centive  structure.  This  award  fee  and 
mission  success  fee  plan  does  not  re¬ 
place  the  traditional  Air  Force  award  fee 
or  mission  success  fee  plans  but  adds 
to  these  concepts  to  create  further  in¬ 
novation  in  the  award  fee  incentive 
structure. 


"Rollover  of 
fee  is  Hie  ability  of 
the  FDO  to  autho¬ 
rize  unearned  fee 
from  the  current 
fee  period, 
whether  award  fee 
or  mission  success 
fee,  into  subse¬ 
quent  fee 
periods." 
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Risk  Fee  Covenant  Clause 

The  risk  fee  covenant  clause6  is  asso¬ 
ciated  with  the  incentive  fees  on  con¬ 
tract.  Although  the  contractor  will  earn 
incentive  fees  during  the  course  of  this 
contract,  the  award  fee  and  mission  suc¬ 
cess  fee  earned  during  the  EMD  phase 
of  the  contract  are  earned  at  risk.  Simi¬ 
larly,  the  fixed-price-incentive  profit, 
award  fee,  and  mission  success  fee 
earned  during  the  production  efforts  on 
each  replenishment  satellite  are  also 
earned  at  risk.  This 
means  the  contractor 
has  earned  the  fee;  how¬ 
ever,  the  contractor  may 
have  to  return  up  to  100 
percent  of  the  fee  if  it 
fails  to  provide  a  system 
that  provides  useful  ser¬ 
vice.  Under  this  incen¬ 
tive  structure,  the  FDO 
will  make  assessments 
according  to  the  risk  fee  covenant  clause 
to  retire  fee  at  risk.  The  FDO  will  con¬ 
sider  the  inputs  and  suggestions  of  the 
contractor  in  the  assessment,  but  the  fi¬ 
nal  decision  is  the  FDO’s  subjective  de¬ 
cision. 

For  the  EMD  phase,  the  assessments 
are  on  overall  system  performance.  There 
is  a  complicated  formula  for  the  three 
fee  risk  removal  periods  as  stated  in  the 
contract  clause, 

The  fee  risk  removal  pool  for  this 
period  [initial]  is  equal  to  the  award  fee 
and  mission  success  fee  on  the  EMD 
CLINs  [Contract  Line  Item  Number] 
earned  to  that  point.  Up  to  one  tenth  of 
this  risk  may  be  removed  at  each  six- 
month  risk  retirement  assessment  based  on 
the  FDO’s  subjective  assessment  of 
overall  system  performance  during  the 


"The  award 
fee  and  mission 
success  foe  plan 
also  have  a 
provision  lor 
rollover  of 
award  fee." 


previous  six-month  period.  The  FDO’s 
assessment  will  be  a  numerical  percent¬ 
age  between  100  percent  and  0  percent, 
where  100  percent  =  completely  success¬ 
ful  and  0  percent  =  completely  unsuccess¬ 
ful.  The  fee  risk  removed  at  that  instance 
is  a  factor  of  the  FDO’s  assessment  per¬ 
centage  against  the  one-tenth  figure  avail¬ 
able  at  that  decision....  The  fee  risk  re¬ 
moval  pool  for  this  period  [second]  is  equal 
to  the  EMD  award  fee  and  mission  suc¬ 
cess  fee  earned  to  that  point,  less  the  fee 
risk  removed  during  the  initial  period.  This 
means  any  fee  risk  not  removed  in  the  ini¬ 
tial  phase  may  yet  be  removed  during  the 
second  phase.  Up  to  one-tenth  of  this  risk 
may  be  removed  at  each  six-month  risk 
retirement  assessment  based  on  the  FDO’s 
subjective  assessment  of  overall  system 
performance  during  the  previous  six- 
month  period. 

The  fee  risk  removed  at  each  assess¬ 
ment  is  factored  in  the  same  manner  as 
during  the  initial  period  described 
above....  The  final  fee  risk  retirement 
period  for  the  EMD  phase  starts  with 
the  second  assessment  after  the  IOC 
declaration  and  runs  until  all  fee  risk  is 
removed.  The  fee  risk  removal  pool  for 
this  period  is  equal  to  all  the  award  fee 
and  mission  success  fee  earned  during 
the  EMD  phase,  less  the  fee  risk  re¬ 
moved  during  the  initial  and  second 
periods.  This  means  any  fee  risk  not 
removed  in  the  initial  and  second  peri¬ 
ods  may  yet  be  removed  during  the  fi¬ 
nal  phase.  Up  to  one-tenth  of  this  risk 
may  be  removed  at  each  six-month  risk 
retirement  assessment  based  on  the 
FDO’s  subjective  assessment  of  overall 
system  performance  during  the  previ¬ 
ous  six-month  period.  The  fee  risk  re¬ 
moved  at  each  assessment  is  factored 
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in  the  same  manner  as  during  the  initial 
period. 

Under  the  production  phase  for  each 
production  option,  fee  risk  reduction  is 
also  a  complicated  formula,  as  stated  in 
the  contract: 


The  fee  risk  removal  pool  for  this 
period  [initial]  is  equal  to  the  actual 
profit  arrived  at  through  application 
of  the  fixed-price-incentive  arrange¬ 
ment,  the  award  fee,  and  the  mis¬ 
sion  success  fee  attributable  to  that 
satellite  (however,  it  does  not  in¬ 
clude  the  cost  mitigation  incentive, 
if  any).  Up  to  one-fourteenth  of  this 
risk  may  be  removed  at  each  six- 
month  risk  retirement  assessment 
based  on  the  FDO’s  subjective  as¬ 
sessment  of  the  satellite’s  success 
during  the  previous  six-month  pe¬ 
riod.  The  FDO’s  assessment  will  be 
a  numerical  percentage  between 
100  percent  and  0  percent,  where 
100  percent  =  completely  success¬ 
ful  and  0  percent  =  completely  un¬ 
successful.  The  fee  risk  removed  at 
that  instance  is  a  factor  of  the  FDO’s 
assessment  percentage  against  the 
one-fourteenth  figure  available  at 
that  assessment. . ..  The  final  fee  risk 
retirement  period  starts  with  the  as¬ 
sessment  immediately  following 
launch  of  the  satellite  and  continues 
until  all  fee  risk  is  removed.  The  fee 
risk  removal  pool  for  this  period  is 
unchanged  from  the  initial  period. 
Up  to  one-fourteenth  of  this  risk  may 
be  removed  at  each  six-month  risk 
retirement  assessment  based  on  the 
FDO’s  subjective  assessment  of  the 
satellite’s  success  during  the 
previous  six-month  period.  The  fee 


risk  removed  at  each  assessment  is 
factored  in  the  same  manner  as  dur¬ 
ing  the  initial  period  and  if  the  FDO 
fails  to  make  a  fee  risk  reduction  as¬ 
sessment  in  January  or  July  of  any 
year,  the  contractor  may  treat  this  as 
a  favorable  100  percent  success  as¬ 
sessment  for  that  period.  (NPOESS 
A&O  Contract,  August  22,  2002) 

That  last  statement  is  important  be¬ 
cause  it  puts  the  onus  on  the  government 
to  manage  the  contract  and  maintain  ad¬ 
herence  to  the  criteria  for  retiring  the  fee. 
This  clause  measures  and  analyzes  the  fee 
structures  put  at  risk  on  this  contract. 
Attachment  4  to  the  NPOESS  Request  For 
Proposal  gave  a  detailed,  quantitative 
analysis  of  the  risk  fee  covenant  clause 
as  follows: 

Iniiial  Fee  Risk  Removal  Period 

Sample  figures  are  shown  below: 

•  $50,000,000  award  fee  earned  through 

December  2006. 

•  $25,000,000  mission  success  fee 

earned  through  December  2006. 

Step  one  —  Determine  the  fee  risk 
removal  pool  for  the  initial  period.  This 
is  the  sum  of  the  award  fee  and  mission 
success  fee  earned  through  the  start  of 
the  period.  In  this  example,  it  is 
$75,000,000. 

Step  two  —  Determine  the  amount 
available  for  fee  risk  removal  at  each 
six-month  decision.  This  is  one-tenth  of 
the  fee  risk  removal  pool.  In  this  ex¬ 
ample,  it  is  $7,500,000. 

Step  three  —  The  FDO  performs  an 
assessment  at  each  six-month  decision, 
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and  the  fee  risk  removed  is  the  assess¬ 
ment  factored  against  the  amount  avail¬ 
able  for  risk  removal  at  that  decision. 
In  this  example,  a  100  percent  success 
assessment  will  retire  risk  on 
$7,500,000;  a  90  percent  success  as¬ 
sessment  will  retire  risk  on  $6,750,000; 
an  80  percent  success  assessment  will 
retire  risk  on  $6,000,000,  and  so  forth. 
An  illustrative  initial  period  is  provided 
below  in  Figure  3,  Fee  Risk  Removal 
—  Example  1.  This  shows  an  example 
where  the  FDO  made  100  percent  suc¬ 
cess  assessments  in  January  2007,  Janu¬ 
ary  2009,  and  July  2009,  with  50  per¬ 
cent  success  assessments  in  every  other 
period. 

It  should  be  noted  that  it  is  not  pos¬ 
sible  to  remove  the  risk  on  the  entire 
risk  removal  pool  during  the  initial  pe¬ 
riod.  The  portion  where  the  risk  is  not 
yet  removed  rolls  over  into  the  second 
fee  risk  removal  period  and  becomes 
part  of  the  second  period. 

Second  Fie  Risk  Removal  Period 

Sample  figures  are  shown  following: 

•  $72,500,000  award  fee  earned 

through  December  2009  (includes 


the  $50,000,000  earned  in  the  ini¬ 
tial  period). 

•  $37,500,000  mission  success  fee 
earned  through  December  2009  (in¬ 
cludes  the  $25,000,000  earned  in 
the  initial  period). 

Step  one  —  Determine  the  fee  risk  re¬ 
moval  pool  for  the  second  period.  This  is 
the  sum  of  the  award  fee  and  mission  suc¬ 
cess  fee  earned  through  the  start  of  the  pe¬ 
riod  (including  the  fee  earned  during  the 
initial  period),  less  the  fee  risk  removed 
during  the  initial  period  —  in  this  example, 
the  earned  fee  is  $110,000,000  and  the  fee 
risk  removed  during  the  initial  period  is 
$33,750,000,  so  the  fee  risk  removal  pool 
for  the  second  period  is  $76,250,000. 

Step  two  —  Determine  the  amount  avail¬ 
able  for  fee  risk  removal  at  each  six-month 
decision.  This  is  one-tenth  of  the  fee  risk 
removal  pool.  In  this  example,  it  is 
$7,625,000. 

Step  three  —  The  FDO  performs  an  as¬ 
sessment  at  each  six-month  decision,  and 
the  fee  risk  removed  is  the  assessment  fac¬ 
tored  against  the  amount  available  for  risk 
removal  at  that  decision.  In  this  example,  a 
100  percent  success  assessment  will  retire 


Jan  2007 

Jul  2007 

Jan  2008 

Jul 2008 

Jan  2009 

Jul  2009 

Available: 

$7,500,000 

$7,500,000 

$7,500,000 

$7,500,000 

$7,500,000 

$7,500,000 

FDO 

Assessment: 

100% 

50% 

50% 

50% 

100% 

100% 

Fee  Risk 
Removed: 

$7,500,000 

$3,750,000 

$3,750,000 

$3,750,000 

$7,500,000 

$7,500,000 

Cumulative 

Removal: 

$7,500,000 

$11,250,000 

$15,000,000 

$18,750,000 

$26,250,000 

$33,750,000 

Figure  3.  Fee  Risk  Removal  —  Example  1 
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risk  on  $7,625,000;  a  90  percent  success 
assessment  will  retire  risk  on  $6,862,500; 
an  80  percent  success  assessment  will  retire 
risk  on  $6,100,000,  and  so  forth.  An  illus¬ 
trative  second  period  is  provided  below  in 
Figure  4.  This  shows  an  example  where  the 
FDO  made  100  percent  success  assessments 
in  January  2007,  January  2009,  and  July 
2009,  with  80  percent  success  assessments 
in  every  other  period. 

It  should  be  noted  that  this  example  pre¬ 
sumes  IOC  in  September  2011,  but  it  could 
occur  earlier  or  later  —  in  such  a  case,  this 
period  could  have  more  or  fewer  decisions 
than  illustrated  here. 

Final  Fee  Risk  Removal  Period 

Sample  figures  are  shown  below: 

•  $100,000,000  award  fee  earned 
through  December  2009  (includes  the 
$72,500,000  earned  in  the  initial  and 
second  periods). 

•  $50,000,000  mission  success  fee 
earned  through  December  2009 
(includes  the  $37,500,000  earned  in  the 
initial  and  second  periods). 


Step  one  —  Determine  the  fee  risk  re¬ 
moval  pool  for  the  final  period.  This  is  the 
sum  of  the  award  fee  and  mission  success 
fee  earned  through  the  start  of  the  period 
(including  the  fee  earned  during  the  initial 
and  second  periods),  less  the  fee  risk  re¬ 
moved  during  the  initial  and  second 
periods.  In  this  example,  the  earned  fee  is 
$150,000,000  and  the  fee  risk  removed 
during  the  initial  and  second  periods  is 
$67,300,000  ($33,750,000  and 

$33,550,000,  respectively),  so  the  fee  risk 
removal  pool  for  the  second  period  is 
$82,700,000. 

Step  two  —  Determine  the  amount 
available  for  fee  risk  removal  at  each  six- 
month  decision.  This  is  one-tenth  of  the 
fee  risk  removal  pool.  In  this  example,  it  is 
$8,270,000. 

Step  three  —  The  FDO  performs  an 
assessment  at  each  six-month  decision,  and 
the  fee  risk  removed  is  the  assessment  fac¬ 
tored  against  the  amount  available  for  risk 
removal  at  that  decision.  In  this  example, 
a  100  percent  success  assessment  will  re¬ 
tire  risk  on  $8,270,000;  a  90  percent  suc¬ 
cess  assessment  will  retire  risk  on 
$7,443,000;  an  80  percent  success  assess¬ 
ment  will  retire  risk  on  $6,616,000,  and 


Jan  2010 

Jul  2010 

Jan  2011 

Jul  2011 

Jan  2012 

Available: 

$7,625,000 

$7,625,000 

$7,625,000 

$7,625,000 

$7,625,000 

FDO 

Assessment: 

100% 

80% 

80% 

80% 

100% 

Fee  Risk 

Removed: 

$7,625,000 

$6,100,000 

$6,100,000 

$6,100,000 

$7,625,000 

Cumulative 

Removal: 

$7,625,000 

$13,725,000 

$19,825,000 

$25,925,000 

$33,550,000 

Figure  4.  Fee  Risk  Removal  —  Example  2 
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so  forth.  A  table  for  the  final  period  is  not 
provided,  but  the  mechanics  are  identical 
to  those  illustrated  in  the  initial  and  sec¬ 
ond  period  examples  above.  The  period 
will  continue  with  six-month  decisions  un¬ 
til  the  entire  fee  at  risk  is  retired. 

The  transformation  of  the  contract  per¬ 
formance  incentive  structure  established 
by  this  clause  looks  at  ways  to  incentivize 
the  contractor  to  present  an  operational 
system  to  the  govern¬ 
ment  as  proposed  at 
contract  award.  This 
clause  gains  significant 
benefits  to  both  the  gov¬ 
ernment  and  contractor 
and  is  established  using 
a  fair  incentive  structure 
to  retire  fee  at  risk  to 
motivate  the  contractor’s 
performance. 


"Th*  final  pillar 
lor  Hia  incentive 
structure  is  an 
equally  innovative 
element  known  cm 
the  cod  mitigation 
incentive  dame." 


Cost  Miiigation  Incentive  Clause 


The  final  pillar  for  the  incentive  struc¬ 
ture  is  an  equally  innovative  element 
known  as  the  cost  mitigation  incentive 
clause.7  The  contractor  is  encouraged  to 
submit  cost  reduction  initiatives  to  the  gov¬ 
ernment  for  review  and  approval.  For  any 
initiative  incorporated  into  the  contract  by 
modification,  the  contractor  is  entitled  to 
share  in  the  contract  savings  resulting 
from  the  implementation  of  the  initiative. 
The  clause  requires  that  each  cost 
mitigation  initiative  be  significant  in 
nature  and  be  beyond  the  scope  of 
the  cost  control  expectations  of  the 
award  fee  incentive.  Acceptance  of  any 
cost  mitigation  initiative  is  entirely  at  the 
government’s  discretion.  However,  the 
contractor’s  share  of  savings  shall  be  the 


cost  mitigation  incentive,  should  the  gov¬ 
ernment  accept  any  cost  mitigation  pro¬ 
posals.  The  incentive  is  not  considered 
fee  for  purposes  of  the  award  fee  and  mis¬ 
sion  success  fee  plan  of  this  contract  and 
is  not  subject  to  fee  risk  retirement. 

The  cost  mitigation  incentive  only 
applies  to  the  production  effort  of  the  A&O 
contract.  For  each  production  option  on 
contract  at  the  time  of  contract  award,  the 
contractor  proposed  a  firm  target  price.  The 
government  will  have  the  unilateral  right 
to  exercise  the  option  at  that  price,  at  the 
appointed  time.  However,  since  the  price 
at  contract  award  will  likely  include  some 
factor  for  risk  that  might  not  materialize 
during  the  performance  of  the  contract,  the 
government  wanted  to  incentivize  the  con¬ 
tractor  to  manage  and  reduce  the  risk  so 
that  as  the  option  exercise  time  approaches, 
the  parties  could  agree  that  a  lower  target 
price  as  a  cost  and  risk  mitigation.  Under 
this  scenario,  the  contractor  would,  at  its 
discretion,  submit  a  proposal  with  a  lower 
target  price  to  renegotiate  the  option 
price(s).  The  proposal  would  include  details 
of  the  assumptions  and  analysis  upon 
which  the  new  proposal  is  based  for  the 
government’s  consideration.  The  govern¬ 
ment  already  has  insight  to  the  contractor’s 
cost  and  risk  at  contract  award  for  the  pro¬ 
duction  options  on  contract;  however,  the 
new  proposal  would  detail  any  risk  reduc¬ 
tion  activities  and  cost  mitigation  to  the  pro¬ 
duction  option(s). 

After  a  comprehensive  review  by  the 
government,  the  parties  may  agree  to 
modify  the  contract  to  reflect  the  new 
lower  target  price.  The  terms  and  condi¬ 
tions  of  the  option  under  renegotiation 
would  remain  unchanged  with  the  con¬ 
tractor’s  incentive  being  that  if  the  gov¬ 
ernment  concurs  with  the  proposal,  the 
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less  tangible  because  of  the  formula  and 
allowable  costs  for  value  engineering  sav¬ 
ings.  By  eliminating  the  complex  formu¬ 
las  and  transforming  the  traditional  value 
engineering  process  into  a  new  business 
process,  the  program  office  has  in  fact 
changed  the  way  the  government  formu¬ 
lates  a  savings  under  the  A&O  contract. 

The  savings  is  real  and  apparent. 

The  same  holds  true  for  collateral  sav¬ 
ings  whereby  costs  of  operation,  mainte¬ 
nance,  logistic  support,  or  government-fur¬ 
nished  property  are  reduced  by  the  option 
price  reduction  without  a  reduction  in  scope 
of  the  option.  The  intentions  of  this  incen¬ 
tive  are  to  enable  the  gov¬ 
ernment  to  obtain  insight 
into  the  contractor’s  pric-  "The  hey  to  the 
ing  of  its  FPIF  production  cost  mitigation 
options,  including  the  incentive  is  timing 
risk  assumptions  built  of  receiving  the 
into  the  target  price.  This  ‘  profH  and  cash 
process  should  also  *ow* 
incentivize  the  contrac¬ 
tor  to  manage  these  risks 
before  option  exercise  and  take  mitigating 
steps  to  reduce  the  target  cost  of  the  option 
before  it  is  exercised.  By  using  these  inno¬ 
vative  concepts  to  incentivize  the  contrac¬ 
tor,  the  NPOESS  program  is  transforming 
the  way  the  Air  Force  and  the  DOC  con¬ 
duct  contract  administration.  These  in¬ 
novations  look  to  increase  productivity, 
decrease  cost  overruns,  and  provide  the 
government  with  a  best  value  satellite 
system  for  the  next  generation  of  weather 
satellites. 

Summary 


contractor  receives  50  percent  of  the  dif¬ 
ference  between  the  original  option  target 
price  and  the  new  lower  target  price.  The 
government  still  has  the  ability  to  exercise 
the  current  option  on  contract  at  the  agreed 
upon  price. 

Under  the  scenario  where  the  current 
option  is  exercised  without  any  cost  miti¬ 
gation,  and  the  contractor  reduces  cost,  the 
contractor  still  has  the  share  ratio  to  net 
profit  for  the  cost  mitigation  efforts.  The 
key  to  the  cost  mitigation  incentive  is  tim¬ 
ing  of  receiving  the  profit  and  cash  flow.  If 
the  contractor  submits  a  cost  mitigation  pro¬ 
posal  and  the  government  accepts  the 
downward  revision,  the  contractor  receives 
the  incentive  at  exercise  of  option  instead 
of  after  performance.  There  is  also  an  im¬ 
mediate  savings  to  the  government  since 
obligations  would  be  reduced  by  the  in¬ 
centive  amount.  If  the  contractor  eventu¬ 
ally  overruns,  the  ceiling  price  and  share 
ratio  are  applied  for  reduced  costs  and 
profit  as  applicable  to  the  option  pricing. 

The  cost  mitigation  incentive  clause 
complements  the  award  fee  and  mission 
success  fee  plan  to  form  a  solid  incentive 
fee  structure  for  the  contract.  While  the  cost 
mitigation  incentive  clause  seems  like  a  re¬ 
vised  value-engineering  clause,  in  essence 
cost  mitigation  incentives  reinvented  the 
meaning  of  value  engineering  for  this  pro¬ 
gram  by  giving  better  insight  on 
acquisition  savings  and  collateral  savings 
than  proposed  by  FAR  48.  The  acquisition 
savings  for  this  contract  are  under  the  pro¬ 
duction  options,  giving  an  immediate  or 
instant  contract  savings  over  current  units 
and  potential  future  production  units  if  the 
proposal  is  accepted.  This  immediate  sav¬ 
ings  is  tangible  and  seen  in  the  reduction 
of  option  prices;  where  in  the  traditional 
value  engineering  proposal,  the  savings  are 


NPOESS  has  initiated  an  innovative 
transformation  from  the  traditional  contract 
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performance  incentive  structure  to  moti¬ 
vate  contractor  performance.  The  pro¬ 
gram  has  reinvented  the  award  fee  and 
mission  success  fee  plans  into  a  compre¬ 
hensive  incentive  package  with  interim 
payment  methods  using  global  contract¬ 
ing  concepts  tailored  to  individual  use  in 
the  NPOESS’  acquisition  strategy.  The 
A&O  contract  for  the  development  and 
production  of  the  next  generation  weather 
satellites  has  adapted  to  the  current  acqui¬ 
sition  environment  with  select  innovations 
in  business  practices  such  as  establishing 
a  base  fee,  interim  award  fee  payments, 
cost  mitigation  incentives,  and  risk  reduc¬ 
tion  incentives  to  reduce  cost  overruns  and 
increase  productivity, 
with  an  SSPR  and  shared 
ownership  concepts  for 
technical  competencies. 
The  incentive  structure 
under  the  A&O  contract 
is  a  comprehensive  and 
flexible  system  for 
achieving,  sustaining, 
and  maximizing  pro¬ 
grammatic,  business,  and 
acquisition  success. 

The  A&O  contract 
offers  industry  the  op¬ 
portunity  to  realize  commercial  rates  of 
return.  The  EMD  portion  of  the  contract 
will  use  cost  reimbursement  line  item 
structure  with  a  base  fee  to  ensure  ade¬ 
quate  cash  flow  for  successful  program 
execution;  an  award  fee  that  provides  sub¬ 
stantial  returns  for  successful  technical, 
schedule  and  cost  management;  and 
mission  success  fees  awardable  on 
achievement  of  significant  program 
events  and  on-orbit  performance.  The 
production  portion  of  the  contract  will  use 
a  fixed  price  incentive  line  item  structure. 


"The  cost 
mitigation 
incentive  clause 
complements  the 
award  fee  and 
mission  success  fee 
plan  to  form 
a  solid  incentive 
foe  structure  for 
the  contract." 


During  production,  cost  control  is 
incentivized  through  a  50/50  share  ration, 
successful  technical  and  schedule  man¬ 
agement  is  recognized  through  an  award 
fee,  and  system  reliability  and  durability 
rewarded  through  on  orbit  incentives. 

The  SSPR  approach  reinvents  the  to¬ 
tal  system  performance  responsibility 
concept  to  a  shared  ownership  concept 
to  increase  productivity  and  bring  a  qual¬ 
ity  first  approach  to  the  technical  and 
business  arrangements  of  the  acquisition 
process.  The  NPOESS  program  provides 
an  opportunity  to  redefine  how  govern¬ 
ment  and  industry  cooperate  to  procure 
and  deliver  goods  and  services.  The 
NPOESS  program  office  has  created  the 
concept  of  shared  ownership,  a  relation¬ 
ship  between  government  and  industry 
where  risk  and  returns  are  shared.  This 
management  approach  depends  upon 
highly  integrated  management  teams  to 
ensure  adequate  government  insight  and 
oversight  while  maintaining  total  system 
responsibility  by  industry.  Shared  own¬ 
ership  offers  the  potential  to  harness  the 
efficiency  of  commercial  practices  to 
significantly  reduce  the  cost  of  major 
system  acquisitions. 

By  looking  at  new  ways  of  doing 
business  in  the  government,  many  or¬ 
ganizations  develop  success  stories; 
however,  the  NPOESS  program  has  set 
up  such  a  new  and  innovative  incen¬ 
tive  structure  that  it  is  revolutionizing 
the  way  the  DoD  and  DOC  approach 
future  acquisitions. 

The  many  long  hours  developing 
these  approaches  cannot  go  unspoken 
without  mentioning  the  consent  and 
advice  the  program  received  from  key 
procurement  officials  within  the  Air 
Force,  DoD,  NASA,  and  DOC.  It  is 
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through  teamwork  and  partnership 
among  government  agencies  that 
NPOESS  can  truly  be  counted  a  success. 
The  future  of  weather  forecasting  is 
counting  on  the  success  of  the  NPOESS 


A&O  contract  and  the  innovative  incen¬ 
tive  structures  on  contract  to  implement 
the  state-of-the-art  technologies  for 
weather  forecasting  in  the  new 
millennium. 


Robert  Graham  is  the  branch  chief  and  contracting  officer  for  the 
National  Polar-orbiting  Operational  Environmental  Satellite  System 
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Acronyms 


A&O  -  Acquisition  and  Operations 

AFMCFAR  -  Air  Force  Materiel  Command  Federal  Acquisition  Regulation 
AFRB  -  Award  Fee  Review  Board 
CLIN  -  Contract  Line  Item  Number 
CMIS  -  Configuration  Management  Information  Systems 
CPAF  -  Cost-Plus-Award-Fee 
CPCM  -  Certified  Professional  Contracts  Manager 
DOC  -  Department  of  Commerce 
DoD  -  Department  of  Defense 
DMSP  -  Defense  Meteorological  Satellite  Program 
EMD  -  Engineering,  Manufacturing,  and  Development 
FAR  -  Federal  Acquisition  Regulation 
FDO  -  Fee  Determining  Official 
FFRDC  -  Federally  Funded  Research  and  Development  Center 
FPIF  -  Fixed-Price-Incentive-(Firm  Target) 

GFP  -  Government-Furnished  Property 
IOC  -  Initial  Operational  Capacity 
IPO  -  Integrated  Program  Office 
IPT  -  Integrated  Product  Teams 
MOA  -  Memorandum  of  Agreement 
NASA  -  National  Aeronautics  and  Space  Administration 
NCMA  -  National  Contract  Management  Association 
NOAA  -  National  Oceanic  and  Atmospheric  Administration 

NPOESS  -  National  Polar-orbiting  Operational  Environmental  Satellite 
System 


PDR  -  Preliminary  Design  Review 
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PDRR  -  Preliminary  Design  Risk  Reduction 

POES  -  Polar-orbiting  Operational  Environmental  Satellite 

SSPR  -  Shared  System  Performance  Responsibility 
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Endnotes 


1.  NPOESS  Acquisition  and  Opera¬ 
tions  (A&O)  Contract.  (August  22, 
2002).  Special  Contract  Require¬ 
ments  Clause  H-500,  “Shared  Sys¬ 
tem  Performance  Responsibility 
(January  2002).” 

2.  NPOESS  Acquisition  and  Opera¬ 
tions  (A&O)  Contract.  (August  22, 
2002).  Special  Contract  Require¬ 
ments  Clause  H-503,  “Shared  Own¬ 
ership  (January  2002).” 

3.  NPOESS  Acquisition  and  Opera¬ 
tions  (A&O)  Contract.  (August  22, 
2002).  Award  Fee  and  Mission  Suc¬ 
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4.  NPOESS  Acquisition  and  Opera¬ 
tions  (A&O)  Contract.  (August  22, 
2002).  Special  Contract  Require¬ 
ments  Clause  H-519,  “Interim 
Award  Fee  Payment  and  Adjust¬ 
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Clause  5352.216-9003. 

6.  NPOESS  Acquisition  and  Opera¬ 
tions  (A&O)  Contract.  (August  22, 
2002).  Special  Contract  Require¬ 
ments  Clause  H-521,  “Fee  Risk 
Covenant  (January  2002).” 

7.  NPOESS  Acquisition  and  Opera¬ 
tions  (A&O)  Contract.  (August  22, 
2002).  Special  Contract  Require¬ 
ments  Clause  H-524,  “Cost  Mitiga¬ 
tion  Incentive  (January  2002).” 
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OPINION 


INVESTIGATING  THE  INTEGRATION 
OF  ACQUIRED  FIRMS  IN 
HIGH-TECHNOLOGY  INDUSTRIES: 

IMPLICATIONS  FOR  INDUSTRIAL  POLICY 

Mai  David  R.  King,  U5AF  and  U  Col  John  D.  Driessnack,  U5AF 


Acquisition  activity  persists  despite  evidence  that  acquisitions  do  not  improve 
firm  performance.  Further,  government  policy  toward  the  defense  industry  has 
advocated  consolidation  in  the  name  of  nominal  cost  savings.  We  explore  the 
role  acquisitions  play  toward  technology  transfer  and  begin  to  identify  factors 
associated  with  acquisition  success  through  a  review  of  existing  research  on 
post-acquisition  performance  that  primarily  considers  acquiring  firm  stock 
performance.  Using  this  research  as  a  foundation,  we  build  a  model  to  analyze 
post-acquisition  performance  using  a  sample  of  high-technology  firms.  Results 
suggest  critical  success  factors  associated  with  post-acquistion  stock 
performance  are  poorly  understood.  We  conclude  that  proactive  government 
policy  toward  high-technology  industry  mergers  and  acquisitions  may  be 
misguided  due  to  difficulty  in  predicting  acquisition  outcomes. 


Merger  and  acquisition  activity  in 
volves  discrete  events  associated 
with  a  high  tempo  of  change  that 
modify  the  competitive  dynamics  of 
affected  industries.  Merged  firms  combine 
additional  resources  and  capacity  that  can 
threaten  the  market  position  and  profitabil¬ 
ity  of  remaining  firms.  The  implications 
of  using  acquisitions  to  alter  competition 


in  industry  may  carry  higher  stakes  in 
high-technology  industries,  because  high- 
technology  firms  are  an  important  source 
of  U.S.  economic  competitiveness  and  are 
key  components  of  the  defense  industrial 
base. 

The  Department  of  Defense  (DoD) 
encouraged  merger  and  acquisition 
(M&A)  activity  after  then  Deputy  Sec- 


DISCLAIMER 

The  views  expressed  in  this  article  are  those  of  the  authors  and  do  not  reflect  the  official  policy  or 
position  of  the  U.S.  Air  Force,  Department  of  Defense,  or  the  U.S.  government. 
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retary  of  Defense  William  Perry  told 
defense  industry  executives  that  declin¬ 
ing  defense  spending  required  consoli¬ 
dation.  The  1993  meeting  became 
known  as  the  “Last  Supper”  and  in  the 
next  four  years  the 
value  of  defense  merg¬ 
ers  was  eight  times  the 
level  of  the  preceding 
four  years  (Augustine, 
1997).  In  a  controversial 
program  that  became  to 
be  known  as  payoffs 
for  layoffs,  the  DoD,  in 
an  effort  to  help  realize 
expected  cost  savings,  reimbursed  de¬ 
fense  firms  for  the  cost  of  merging.  The 
program,  to  date,  has  resulted  in  $4.77 
billion  in  DoD  savings  with  a  corre¬ 
sponding  cost  of  $869  million 
(Department  of  Defense  [DoD],  2002),  or 
approximately  one  percent  of  the  2003 
defense  budget. 

Firms  pursue  acquisitions  to  increase 
performance  (Finkelstein,  1997);  however, 
research  findings  on  the  impact  of  an 
acquisition  on  acquiring  firm  performance 
remains  inconclusive  (e.g.,  Haspeslagh  & 
Jemison,  1991;  Sirower,  1997).  Given  the 
high  level  and  dollar  of  acquisition  activ¬ 
ity,  research  needs  to  identify  factors 
associated  with  acquisition  success.  The 
goal  of  the  current  paper  is  to  begin  to 
answer  the  following  policy  questions: 

1 .  Does  technology  transfer  occur  when 
high-technology  firms  are  acquired? 

2.  Is  it  reasonable  to  anticipate  investor 
benefits  from  defense  industry 
consolidation? 


Technology  as  a  Motivation 
for  Acquisitions 


Acquiring  technology  is  often  the 
motivation  for  acquiring  another  firm.  In 
reviewing  the  different  perspectives 
toward  acquiring  technology,  two  conflict¬ 
ing  perspectives  dominate.  Researchers 
tend  to  either  view  external  technology  as 
a  substitute  for  Barkema  and  Vermeulen 
(1998)  Bower  (2001)  or  a  complement  to 
Cohen  and  Levinthal  (1989, 1990)  internal 
innovation.  Either  view  has  implications 
for  technology  transfer. 

In  the  current  sample1,  the  average 
research  and  development  (R&D)  inten¬ 
sity  for  acquiring  firms  was  significantly 
below  the  average  for  firms  in  their 
industry  (p  <  .001),  suggesting  that  firms 
use  acquisitions  as  a  substitute  for  R&D  or 
that  acquired  technology  is  used  as  a  sub¬ 
stitute  for  internal  innovation. 

However,  acquirers  still  perform  R&D 
and  it  may  provide  a  facilitating  role  to  ac¬ 
quiring  external  technology.  This  idea  re¬ 
lates  to  the  concept  of  absorptive  capac¬ 
ity,  or  the  ability  of  a  firm  to  recognize, 
assimilate,  and  convert  new  information 
to  commercial  ends,  that  is  built  up  through 
R&D  investment  (Cohen  &  Levinthal, 
1989,  1990).  If  firms  acquire  high-tech¬ 
nology  firms  for  the  express  purpose  of 
assimilating  a  target  firm’s  technology, 
there  are  clear  implications  for  the  acquisi¬ 
tion  of  U.S.  companies  by  foreign  firms. 

For  example,  ASM  Lithography  Hold¬ 
ing  NV,  a  Dutch  company,  and  its  May  2001 
acquisition  of  Silicon  Valley  Group  (SVG) 
Inc.  was  delayed,  because  of  national-se¬ 
curity  issues  with  a  SVG  subsidiary,  Tinsley, 
which  makes  lens  polishing  technology  for 
chip  equipment,  satellites,  and  missile 


"Acquiring 
technology 
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guidance  systems  (Clark  &  Simpson, 
2001).  However,  the  acquisition  was 
later  approved  and  completed  in  May 
2001  with  the  caveat  ASM  Lithography 
try  to  divest  Tinsley  over  a  six  month 
period  (Simpson,  2001).2 

Without  national  security  issues  the 
acquisition  of  SVG  would  have  been 
approved,  because  the  Exon-Florio  for¬ 
eign  acquisition  law  does  not  allow  for 
consideration  of  economic  issues  (Simp¬ 
son,  2001).  Foreign  firms  accounted  for 
approximately  five  percent  of  the  acqui¬ 
sitions  of  U.S.  high-technology  firms 
between  1994  and  1997,  and  this  may  be 
an  area  for  expanding  anti-trust  policy.  The 
impact  of  the  technology  transferred  on 
U.S.  economic  competitiveness  is  un¬ 
known,  and  represents  an  opportunity  for 
additional  research. 

Factors  Commonly  Associated 
with  Acquisition  Success 


Similar  to  previous  studies,  the  current 
sample  of  acquisitions,  on  average,  did  not 
lead  to  abnormal  returns  for  acquiring  firms. 
However,  some  acquisitions  performed  bet¬ 
ter  than  others,  so  what  factors  are  associ¬ 
ated  with  acquisition  success?  A  literature 
review  of  46  empirical  studies  of  post-ac¬ 
quisition  performance  published  since 
Jensen  and  Ruback’s  (1983)  review  identi¬ 
fied  little  overlap  in  the  studies  that  research¬ 
ers  considered  important  in  explaining  post¬ 
acquisition  performance.3  We  include  the 
most  commonly  studied  variables  in  our 
analysis  to  avoid  statistical  artifacts  from 
missing  variables.  The  logic  behind  the  most 
commonly  studied  variables,  the  generally 
anticipated  impact  of  each  variable  on 
post-acquisition  performance,  and  their 


significance  in  the  current  study  are 
shown  in  Table  1.  The  following  sections 
further  discuss  this  material. 

Diversification 

The  impact  of  firm  diversification  on 
subsequent  performance  has  received  the 
most  attention  of  researchers  with  some 
measure  of  relatedness  considered  in  30 
of  the  46  studies.  Diversification  involves 
whether  a  firm  acquires  another  firm  in 
its  same  industry,  a  related  acquisition,  or 
a  firm  in  a  different  industry.  Although 
no  relationship  between  acquiring  a  re¬ 
lated  versus  an  unrelated  firm  and  post¬ 
acquisition  performance  has  been  found 
in  some  studies  (e.g.,  Fowler  &  Schmidt, 
1989),  the  preponderance  of  literature 
suggests  acquiring  related  firms  leads  to 
increased  post-acquisition  performance 
(e.g.,  Kusewitt,  1985). 

Current  results  are  consistent  with 
existing  research  in  that  the  acquisition  of 
related  targets  leads  to  higher  post-acqui¬ 
sition  performance  (pc.  05;  one-tail).  How¬ 
ever,  the  observed  rela¬ 
tionship  is  relatively 
weak  with  the  degree 
that  a  target  firm  relates 
to  an  acquirer  only  ex¬ 
plaining  2.1  percent  of 
subsequent  stock  market 
performance.  Still,  the 
results  support  viewing 
technological  progress 
as  largely  path  depen¬ 
dent  with  the  implication 
that  acquiring  firms  are  more  likely  to 
search  and  find  value  in  target  firms  in  ar¬ 
eas  related  to  their  existing  technological 
capabilities.  The  possiblity  of  increased  per¬ 
formance  may  depend  on  a  firm  staying 
in  a  related  industry. 


"Diversification 
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Table  1.  Common  Post-Acquisition  Performance  Research  Variables 


Variable 

Anticipated  Impact  on  Performance 

Current  Findings ' 

Diversification 

Diversification  (e.g.,  acquiring  firms  in  non-related 
industries)  is  expected  to  have  a  negative  impact  on 
performance  (see  Berger  &  Ofek,  1995). 

Expected  impact  is 
supported  (p  <  .05)  and 
explains  2.1%  of  the 
variance  in  performance. 

Relative  Size 
of  Firms 

The  acquisition  of  smaller  firms,  in  comparison  to  the 
acquiring  firm,  is  expected  to  be  easier  and  result  in 
higher  performance  (see  Kusewitt,1985). 

Expected  impact  is 
supported  (p  <  .01)  and 
explains  7.2%  of  the 
variance  in  performance. 

Acquisition 

Experience 

Acquisition  experience  is  generally  considered  to 
positively  impact  performance  (see  Hitt,  Harrison, 

&  Ireland,  2001). 

Expected  impact  is  not 
supported  (p  =  .22). 

Method  of 
Accounting 

Purchase  accounting  is  generally  considered  to  have 
a  positive  impact  on  performance  (see  Ravenscraft 
&  Scherer,  1987). 

Expected  impact  is  not 
supported  (p  =  .15). 

R&D 

Expenditures 

R&D  expenditures  should  improve  post-acquisition 
performance  (see  Cohen  &  Levinthal,  1989, 1990). 

Expected  impact  is  not 
supported  (p  =  .41). 

Friendliness 
of  Acquisition 

Friendly  acquisitions  are  expected  to  lead  to  higher 
performance  (see  Kusewitt,  1985). 

Not  examined  due  to  an 
insufficient  occurrence  of 
hostile  high-technology 
acquisitions. 

Debt  Level 

Firms  with  lower  debt  levels  are  more  likely  to 
experience  higher  performance  (see  Haspeslagh 
&Jemison,  1991). 

Expected  impact  is 
supported  (p  <  .05),  and 
explains  3.0%  of  the 
variance  in  performance. 

Form  of 
Acquisition 

Tender  offers,  in  contrast  to  mergers,  lead  to  higher 
performance  (see  Berkovitch  &  Khanna,  1991). 

Expected  impact  is 
supported  (p  <  .10),  and 
explains  1.8%  of  the 
variance  in  performance. 

Target  Firm 
Performance 

There  are  conflicting  perspectives  on  how  target  firm 
performance  will  impact  an  acquiring  firm’s  post¬ 
acquisition  performance.  Researchers  support 
viewing  post-acquisition  performance  as  independent 
of  target  firm  performance  (Anand  &  Singh,  1997), 
distressed  targets  leading  to  higher  performance 
(Bruton,  Oviatt,  &  White,  1994),  or  profitable  targets 
leading  to  higher  performance  (Mahoney  &  Pandian, 
1992). 

Current  results  suggest 
that  acquiring  firm 
profitability  is  not  related 
to  post-acquisition 
performance  (p  =  .15). 

a  One-tail  tests  of  sianificance. 
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In  constrast  to  this  finding,  defense 
firms  that  are  prime  contractors  have 
tended  to  make  acquisitions  that  both 
consolidate  specific  industries  (e.g.,  air¬ 
craft  and  Lockheed’s  purchase  of  Gen¬ 
eral  Dynamic’s  aerospace  unit)  as  well 
as  across  industries  (e.g.,  aircraft  and 
ships  with  Northrop  Grumman’s  pur¬ 
chase  of  Newport  News  Shipbuilding). 
However,  defense  firms  appear  to  have 
generally  chosen  to  focus  on  acquiring 
other  firms  in  defense  industry  and  not 
expanding  into  commerical  markets.  It 
is  possible  that  the  specialization  of  de¬ 
fense  firms  in  relating  to  their  unique 
customer,  the  government,  provides 
them  an  advantage  that  does  not  corre¬ 
spond  to  traditional  industry  boundaries. 

Relative  Sin  of  Firms 

The  ability  of  an  acquiring  firm  to 
assimilate  a  target  firm  may  be  impacted 
by  their  relative  size  simply  because  it  is 
easier  for  a  larger  firm  to  integrate 
resources  from  a  smaller  firm.  Kitching 
(1967)  found  that  unsuccessful  acquisi¬ 
tions  correlated  strongly  between  firms  of 
similar  size.  Acquisition  risk  may  be  re¬ 
duced  if  the  target  firm  is  large  enough  to 
achieve  ‘critical  mass’  while  remaining 
smaller  than  the  acquiring  firm  (Kusewitt, 
1985),  due  to  decreased  financial  strain 
and  integrative  effort.  Existing  research 
suggests  that,  in  general,  acquisitions  of 
smaller  firms  by  larger  firms  should  lead 
to  higher  performance. 

Current  results  indicate  that  larger 
targets  correlate  with  higher  stock 
gains  (p  <  .01;  one  tail)  and  explain  7.2 
percent  of  the  observed  variance  in  post¬ 
acquisition  performance.  However,  over 
98  percent  of  the  targets  were  still  smaller 
than  the  acquiring  firm.  This  result  appears 


to  confirm  previous  research  that  acqui¬ 
sition  risk  is  reduced  when  a  target  is 
smaller  than  an  acquiring  firm,  but  large 
enough  to  demand  enough  management 
attention  to  ensure  proper  integration. 
For  acquisitions  involving  large,  prime 
defense  contractors,  targets  from  this 
point  forward  will  most  likely  be  smaller 
than  the  prime  defense  contractors.  This 
suggests  a  potential  post-acquisition  per¬ 
formance  advantage  for  prime  contrac¬ 
tors  in  the  defense  industry. 

Acquisition  Experience 

Experience  from  past  acquisitions,  at  the 
organizational  level,  may  build  facilitating 
processes  for  the  identification  and  inte¬ 
gration  of  target  firm  resources  that  may 
be  required  to  improve  post-acquisition 
performance  (Haspeslagh  &  Jemison, 
1991).  However,  consistent  findings  on  the 
relationship  between  ac¬ 
quisition  experience  and 
post-acquisition  perfor¬ 
mance  do  not  exist.  Still, 

Hitt,  Harrison,  and  Ire¬ 
land  (2001)  caution  “the 
importance  of  the  link 
between  managerial  ex¬ 
perience  and  M&A  suc¬ 
cess  should  not  be  un¬ 
derestimated  (p.  55).” 

Current  results  sug¬ 
gest  that  either  high- 
technology  acquisi¬ 
tions  are  unique  with  acquisition  ex¬ 
perience  not  predicting  post-acquisi¬ 
tion  performance  (p  =  .22;  one  tail). 
Alternatively,  this  result  may  imply  that 
firms  could  benefit  from  acquisition  ex¬ 
perience,  and  that  managers  simply 
treat  acquisitions  as  unique  events. 


"...Defense 
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Method  of  Accounting 

Few  studies  control  for  accounting 
method,  even  though  it  has  been  shown  to 
impact  firm  performance  measures 
(Ravenscraft  &  Scherer,  1987).  Histori¬ 
cally,  there  have  been  two  methods  of 
accounting  for  an  acquisition  —  pooling 
of  interests  or  purchase.4  Under  pooling 
of  interests,  assets  of  an  acquired  firm 
are  recorded  at  their  pre-merger  book 
value  and  the  difference  in  amount  paid 
for  a  firm  is  either  deb¬ 
ited  or  credited  to 
acquirer’s  stockhold¬ 
ers  equity  account. 
Under  purchase  ac¬ 
counting,  acquired  as¬ 
sets  are  entered  at  the 
effective  price  paid. 
Pooling  of  interest  ac¬ 
counting  is  signifi¬ 
cantly  associated  with 
higher  acquisition  pre¬ 
miums  (Ravenscraft  &  Scherer,  1987) 
and  the  premium  paid  negatively  im¬ 
pacts  post-acquisition  performance 
(Sirower,  1997).  Current  results  suggest 
that  method  of  accounting  does  not 
impact  post-acquisition  performance 
( p  =  .15;  one-tail). 

R&D  Expenditure 

Research  suggests  that  increased  tech¬ 
nological  capability  enables  firms  to  be 
aware  of  the  significance  of  new  external 
technology  (Berry  &  Taggart,  1998).  Nel¬ 
son  and  Winter  (1978)  argue  that  the 
capacity  to  recognize  and  exploit  techno¬ 
logical  opportunities  is  a  function  of  a 
firm’s  technology  resource  commitments, 
such  as  R&D  investments,  and  that  firms 
that  track  the  progress  of  technology 
tend  to  prosper.  R&D  investments  build 


"Friendly 
acquisitions 
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internal  technological  capabilities  that 
help  firms  adapt  to  changing  markets 
(Zahra  &  Covin,  1993).  Additionally, 
more  R&D  intensive  firms  should  be 
more  proactive  in  exploiting  external  op¬ 
portunities  (Cohen  &  Levinthal,  1990). 
However,  current  results  suggest  that 
there  may  be  diminishing  returns  to 
performing  R&D  beyond  some  thresh¬ 
old  level.  In  other  words,  firms  may  only 
need  to  perform  enough  R&D  to  remain 
aware  of  external  technology  and  main¬ 
tain  the  ability  to  absorb  needed  tech¬ 
nological  developments. 

Friendliness  of  Acquisitions 

Friendly  acquisitions  involve  transac¬ 
tions  where  an  acquiring  firm’s  overtures 
are  not  resisted  by  a  target  firm’s  top  man¬ 
agement.  Theory  suggests  friendly  acqui¬ 
sition  should  lead  to  higher  performance. 
For  example,  Kusewitt  (1985)  simply 
stated:  “unfriendly  takeovers  should  be 
avoided  (p.  166).”  Consequently,  hostile 
acquisitions  are  relatively  infrequent  with 
only  172  hostile  acquisitions  out  of  over 
35,000  completed  between  1976  and  1990 
(Jensen,  1993).  Therefore,  whether  an 
acquisition  was  friendly  is  not  included 
in  the  current  analysis,  due  to  a  lack  of 
observed  hostile  acquisitions. 

Debt  Level 

The  debt  of  an  acquiring  firm  may 
impact  post-acquisition  performance. 
Unused  debt  capacity  can  be  regarded  as 
a  firm  resource  (Haspeslagh  &  Jemison, 
1991),  and  if  an  acquiring  firm  cannot 
afford  the  price  demanded  by  a  target,  the 
anticipated  synergies  in  a  combined  com¬ 
pany  cannot  be  achieved.  Additionally, 
higher  debt  levels  may  lead  to  more 
strict  financial  controls  that  can  decrease 
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performance  (Hitt,  Hoskisson,  Johnson, 
&  Moesel,  1996).  Present  results  sug¬ 
gest  that  firms  with  less  debt  experience 
higher  subsequent  performance  (p  <  .05; 
one  tail)  with  debt  explaining  three  per¬ 
cent  of  the  variance  in  an  acquiring 
firm’s  post-acquisition  performance.  It 
appears  that  increased  debt  levels  repre¬ 
sent  an  additional  burden  for  acquiring 
firms  seeking  increased  performance. 
This  represents  a  challenge  for  most 
defense  firms  since  they  carry  relatively 
large  levels  of  debt  and  poor  credit  rat¬ 
ings  (Defense  Science  Board,  2000). 

Form  of  Acquisition 

The  form  of  an  acquisition  involves 
the  nature  of  the  offer  made  by  an  ac¬ 
quiring  firm  with  the  primary  choices 
involving  either  a  tender  offer  or  a 
merger  Berko vitch  &  Khanna,  1991). 
Tender  offers,  or  proposals  made  di¬ 
rectly  to  a  target  firm’s  shareholders,  are 
made  through  public  bids,  while  merg¬ 
ers,  or  negotiations  directly  with  a  tar¬ 
get  firm’s  managers,  are  generally  initi¬ 
ated  under  a  veil  of  secrecy.  Existing 
research  has  found  that  tender  offers 
significantly  outperform  mergers  (Rau 
&  Vermealen,  1998).  Berkovitch  and 
Khanna  (1991)  propose  that  the  differ¬ 
ence  in  performance  results  from  dif¬ 
ferences  in  the  amount  of  information 
made  public  during  a  tender  offer  ver¬ 
sus  a  merger,  where  the  greater  infor¬ 
mation  disclosure  in  tender  offers  leads 
increased  synergy.  The  basis  of 
Berkovitch  and  Khanna’s  (1991)  argu¬ 
ment  is  that  tender  offers  lead  to  greater 
competition  for  a  target  firm.  However, 
an  alternate  explanation  relevant  to  the 
acquisition  of  technology  resources  is 
that  the  increased  information  disclosure 


of  tender  offers  decreases  the  amount  of 
uncertainty  target  firm  employees’ 
experience. 

Acquisitions  create  uncertainty  for  em¬ 
ployees  in  target  firms  leading  to  a  ten¬ 
dency  toward  self-preservation  that  inhib¬ 
its  transfer  of  capabilities  and  resources 
(Haspeslagh  &  Jemison,  1991).  Em¬ 
ployee  resistance  to  integration  is  particu¬ 
larly  relevant  in  the  assimilation  of  the 
technology  resources  because  the  implicit 
expertise  of  R&D  personnel  is  far  more 
valuable  than  the  technology  they  have 
developed  (Bower,  2001). 

Whatever  the  ultimate 
reason,  acquisitions  com¬ 
pleted  through  a  tender 
offer  are  expected  to  be 
positively  related  to  post¬ 
acquisition  performance. 

Current  results  suggest 
that  tender  offers  do  lead 
to  higher  post-acquisition 
performance  (p  <  .10; 
one  tail)  with  form  of  ac¬ 
quisition  explaining  1.8 
percent  of  the  variance  in 
post-acquisition  perfor¬ 
mance.  This  result  supports  either  ten¬ 
der  offers  resulting  in  increased  compe¬ 
tition  or  information  disclosure  leads  to 
increased  post-acquisition  performance. 

Target  Firm  Performance 

It  seems  reasonable  that  would-be 
acquirers  will  evaluate  the  attractiveness 
of  a  target  firm’s  resources  in  light  of  the 
firm’s  performance.  However,  consistent 
guidance  on  the  expected  relationship 
does  not  exist.  There  are  at  least  three 
possible  relationships  between  target  firm 
performance  and  an  acquiring  firm’s 
post-acquisition  performance. 
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First,  acquiring  firm’s  may  view  target 
firm  profitability  as  a  signal  of  the  value 
attached  to  its  technological  resources  by 
would-be  acquirers.  Specifically,  it  is  pos¬ 
sible  that  would-be  acquirers  will  inter¬ 
pret  positive  profitability  as  the  market’s 
independent  verification  that  the  target 
firm  possesses  valuable  resources.  High 
profits  signal  uncertain  instability  and  the 
more  firm  specific  or  rare  a  firm’s  re¬ 
sources,  the  more  likely  the  firm  will  earn 
above  normal  rates  of  return  (Mahoney 
&  Pandian,  1992).  Therefore,  higher  post¬ 
acquisition  performance  may  result  from 
acquiring  target  firms  that  possess  valu¬ 
able  resource  combinations  indicated  by 
higher  profitability. 

The  second  possibility  is  that,  con¬ 
sistent  with  Bruton,  Oviatt,  and  White’s 
(1994)  observations,  acquirers  are  particu¬ 
larly  attracted  to  dis¬ 
tressed  firms  with 
resources  of  known  or 
potential  value  to  the 
acquirer.  The  assump¬ 
tion  here  is  that  the  tar¬ 
get  firm’s  poor  financial 
performance  is  a  reflec¬ 
tion  of  either  resource 
mismanagement  or  the 
absence  of  comple¬ 
mentary  resources  needed  to  create 
competitive  advantage.  Thus,  the  acqui¬ 
sition  of  a  poorly  performing  firm  may 
be  attractive  if  the  acquiring  firm  as¬ 
sumes  it  can  improve  the  management 
of  the  target  firm’s  resources  or  success¬ 
fully  combine  them  with  its  own,  pre¬ 
existing  internal  resources. 

Third,  it  may  be  that  target  firm  prof¬ 
itability  has  no  impact  on  an  acquiring 
firm’s  post-acquisition  performance. 
Anand  and  Singh  (1997)  suggest  that 


|  "...acquiring 
I  firms  consider 
i  both  distressed 
and  highly 
|  profitable  firms 
|  as  potential 
|  acquisition 
I  candidates." 


the  benefit  of  transferring  firm  resources 
in  an  acquisition  is  independent  of  the 
acquired  firm’s  prior  performance. 
Therefore,  in  their  opinion,  acquiring 
firms  should  seek  targets  with  resources 
they  need  without  considering  the  prof¬ 
itability  of  the  firms  employing  those 
resources.  Current  results  indicate  that 
target  firm  profitability  in  the  year  prior 
to  an  acquisition  is  not  related  to  post¬ 
acquisition  performance  by  an  acquiring 
firm  (p  =  .15;  one  tail).  This  implies  that 
acquiring  firms  consider  both  distressed 
and  highly  profitable  firms  as  potential 
acquisition  candidates. 


Impact  of  External  Forces  on 
Acquisition  Performance 


The  vast  majority  of  acquisition  re¬ 
search  and  the  variables  discussed  so  far 
only  consider  the  impact  of  variables 
linked  to  factors  internal  to  firms  that  can 
be  directly  observed  and  to  some  extent 
controlled.  However,  it  is  also  reason¬ 
able  that  post-acquisition  performance 
depends  on  factors  external  to  firms. 

We  consider  two  characteristics  that 
may  influence  post-acquisition  perfor¬ 
mance.  First,  an  acquiring  firm’s  envi¬ 
ronment  is  important  because  it  sets  the 
competitive  context,  and  rivalry  over 
scarce  environmental  resources  and  op¬ 
portunities  should  influence  firm  actions 
and  subsequent  performance.  Industry 
characteristics  can  influence  the  perfor¬ 
mance  of  firms  (Porter,  1985).  Further, 
Bergh  (1998)  found  the  benefits  of  ex¬ 
ternal  technology  were  moderated  by  a 
firm’s  environment.  Second,  the  timing 
of  an  acquisition  may  impact  an  acquir¬ 
ing  firm’s  post-acquisition  performance. 
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Table  2.  External  Forces  Influencing  Pest-Acquisition  Performance 


Variable 

Anticipated  Impact  on  Performance 

Current  Findings  ‘ 

Firm 

Environment 

Firms  operating  in  more  attractive 
environments  should  experience  higher 
performance  (see  Dess  &  Beard,  1984). 

1.  Acquiring  firms  operating  in 
munificent  environments  are  more 
likely  to  experience  higher 
performance. 

1 .  Munificence  does  not  impact 
post-acquisition  performance 
(P  =  -28). 

2.  Acquiring  firms  operating  in  less 
dynamic  environments  are  more 
likely  to  experience  higher 
performance. 

2.  Dynamism  does  not  impact 
post-acquisition  performance 
(P  =  -42). 

3.  Acquiring  firms  operating  in  less 
complex  environments  are  more 
likely  to  experience  higher 
performance. 

3.  Complexity  is  significant 
(p  <  .05)  and  explains  2.4  % 
of  post-acquisition  performance. 

Timing  of 
Acquisition 

Early  acquisitions  should  outperform 
later  acquisitions. 

Mixed  support,  but  the  year  an 
acquisition  was  completed  explained 

4.7  %  of  post-acquisition 
performance. 

a  One-tail  tests  of  significance 

The  impact  of  variables  related  to  both 
external  factors  on  subsequent  post-ac¬ 
quisition  performance  is  summarized  in 
Table  2.  The  following  sections  further 
discuss  these  relationships. 

Firm  Envirommint 

Research  supports  viewing  a  firm’s 
environment  as  a  multidimensional  con¬ 
struct  with  three  dimensions  —  munifi¬ 
cence,  dynamism,  and  complexity  (e.g., 
Dess  &  Beard,  1984).  Although  the  la¬ 
bels  applied  to  the  different  dimensions 
vary,  there  is  an  underlying  commonal¬ 
ity  in  the  underlying  concepts.  For  the 


purposes  of  the  present  research,  the  ef¬ 
fects  of  industry  are  controlled  by  com¬ 
puting  firm  measures  relative  to  their 
four-digit  Standard  Industrial  Classifica¬ 
tion  (SIC)  code  using  the  procedures 
described  by  Keats  and  Hitt  (1988). 

Munificence  relates  to  the  scarceness 
of  environment  resources  that  support 
firm  growth  in  a  given  industry  (Dess  & 
Beard,  1984).  This  environmental  dimen¬ 
sion  has  been  discussed  within  the  popu¬ 
lation  ecology  literature  under  the  label 
of  environmental  carrying  capacity 
(Aldrich,  1979).  Munificence  is  charac¬ 
teristically  assumed  to  have  a  positive 
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impact  on  firm  performance  and  is  cal¬ 
culated  from  changes  in  an  industry’s 
net  sales  and  operating  income  during 
the  preceding  five-year  period. 

Current  results  find  that  munificence  is 
not  significant  (p  =  .28;  one  tail)  in 
explaining  an  acquiring  firm’s  post-acqui¬ 
sition  performance.  From  the  perspective 
of  the  1990’s  defense  industry  consolida¬ 
tion,  this  means  that  post-acquisition  per¬ 
formance  may  be  inde¬ 
pendent  of  whether  an 
acquiring  firm’s  industry 
is  contracting.  From  the 
perspective  of  1990’s 
defense  industry  con¬ 
solidation,  defense  firms 
should  have  been  able  to 
adjust  operations  to  sus¬ 
tain  performance  in  face 
of  DoD  spending  that  in 
2001  dollars  declined 
nearly  18  percent  for  R&D  and  56  percent 
for  procurement  between  1987  and  2000 
(DoD,  2000). 

Dynamism  corresponds  to  uncertainty 
or  the  degree  of  instability  and  unpredict¬ 
able  change  in  an  industry  (Dess  &  Beard, 
1984).  Environmental  change  itself  does  not 
imply  dynamism,  instead  dynamism  exists 
when  change  cannot  be  anticipated  and  ad¬ 
equately  predicted,  creating  a  situation  where 
integration  and  coordination  are  more  diffi¬ 
cult.  Williamson  (1975)  suggests  that  un¬ 
der  increasing  environmental  uncertainty 
higher  quality  information  could  be 
gained  by  managing  transactions  inter¬ 
nally  (i.e.,  making  an  acquisition).  Current 
results  suggest  that  industry  volatility  in  and 
of  itself  does  not  impact  post-acquisition 
performance  (p  =  .42;  one  tail).  One 
intrepretation  of  this  result  is  that  firms 
adopt  acquisition  activity  as  a  tool  to 


adapt  to  environmental  change  that  helps 
firms  ensure  their  continued  survival. 
This  is  particularily  relevant  to  the  de¬ 
fense  industry  consolidation  witnessed 
during  the  1990s.5 

Complexity  relates  to  the  number  and 
diversity  of  other  organizations  a  firm 
must  interact  with  (Dess  &  Beard,  1984). 
Complexity  is  reflected  in  such  factors  as 
the  breadth  and  variety  of  a  firm’s  geogra¬ 
phic  markets,  customers,  suppliers,  and 
competitors.  In  general,  fragmented  indus¬ 
tries  are  regarded  as  more  complex  than 
concentrated  industries  (Keats  &  Hitt,  1988). 
In  an  environment  with  fewer  competitors, 
rivalry  often  plays  a  coordinating  role  that 
imposes  competitive  discipline  on  an 
industry  (Keats  &  Hitt,  1988).  In  contrast, 
market  power  and  resources  are  relatively 
widely  and  evenly  distributed  among 
numerous  firms  in  fragmented  industries, 
creating  heterogeneous  conditions  involv¬ 
ing  intense  rivalry.  Thus,  the  dynamics  of 
industry  concentration  may  impact  the 
motivation  and  resulting  performance 
resulting  from  absorbing  recognized 
external  technological  capabilities. 

Current  results  indicate  that  less  com¬ 
plex  (i.e.,  more  concentrated  industries) 
lead  to  higher  post-acquisition  perfor¬ 
mance  (p  <  .05;  one  tail).  At  first  glance, 
this  result  suggests  that  continued  consoli¬ 
dation  of  the  defense  industry  may  be  a 
mistake  in  that  further  consolidation,  at 
this  point,  would  result  in  two  or  fewer 
prime  contractors  for  primary  weapon 
system  platforms  (e.g.,  ships,  aircraft, 
tanks,  satellites,  missiles,  etc.).  Typically 
this  situation  would  raise  concerns  about 
the  ability  of  industry  to  retain  either 
enough  competition  or  sustain  innovation. 
However,  any  monopolistic  power  in 
defense  firms  is  compensated  by  their 
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facing  a  monopsony,  or  market  with  only 
having  a  single  customer  (e.g.,  the  DoD). 
Additionally,  the  government  audits  the 
cost  of  defense  contracts  and  limits  the 
profit  defense  firms  can  earn  from  them. 

It  is  unclear  whether  continued  con¬ 
solidation  in  the  defense  industry  and  any 
anti-competitive  impacts  should  be  a 
concern.  Still,  whether  additional  consoli¬ 
dation  of  defense  firms  occurs  or  not, 
rationalization  of  production  capacity 
should  be  considered.  Despite  industry  con¬ 
solidation  at  the  end  of  the  1990s,  every 
one  of  the  eight  military  aircraft  lines  and 
five  military  helicopter  lines  open  at  the 
end  of  the  Cold  War  were  still  in  produc¬ 
tion  (Sapolsky  &  Gholz,  1999).  To  a  large 
extent,  the  facilities  responsible  for  produc¬ 
ing  5, 195  F-4  Phantom  II  aircraft  (Boeing, 
2002)  and  other  Cold  War  era  weapons 
continue  to  be  maintained.  Not  even  the 
most  optimistic  projections  predict  the 
same  number  of  models  or  quantities  of 
future  aircraft  will  be  produced  due  largely 
to  improvements  in  capability6  and  in¬ 
creased  emphasis  on  jointness. 

Timing  of  Acquisition 

One  possible  explanation  of  an  acquir¬ 
ing  firm’s  post-acquisition  performance 
consistent  with  population  ecology 
(Aldrich,  1979)  is  that  early  acquisitions 
should  outperform  later  acquisitions.  An 
acquisition  represents  an  entry  decision 
for  an  acquiring  firm  that  may  involve 
’’selection”  of  firms  with  better  resources 
(Anand  &  Singh,  1997).  Therefore,  early 
acquirers  may  be  able  to  “select”  the  best 
targets  and  later  acquirers  have  a  de¬ 
creased  and  less  desirable  pool  of  targets 
to  select  from.  Although  the  timing  of  an 
acquisition  has  been  previously  found  to 
be  significant  (Fowler  &  Schmidt,  1988), 


few  studies  include  time  as  an  explana¬ 
tory  power  and  only  Shelton  (1988),  in  a 
study  of  the  impact  of  changing  antitrust 
regulations,  attempts  to  explain  time 
differences  in  acquisition  performance. 

Current  results  suggest  that  the  timing 
of  an  acquisition  is  significant  (p  <  .10)  in 
explaining  an  acquiring  firm’s  performance. 
Based  on  one-tail  significance  tests,  ac¬ 
quisitions  completed  in  1995  (p  <  .10)  and 

1996  (p  <  .05)  performed  significantly 
worse  than  the  1994  ref¬ 
erence  category.  How¬ 
ever,  the  performance  of 
acquisitions  completed  in 

1997  is  not  significantly 
different  from  acquisi¬ 
tions  completed  in  1994. 

The  results  would  appear 
to  show  mixed  support 
for  early  acquisitions  out¬ 
performing  later  acquisi¬ 
tions.  However,  the  nature 
of  the  cross-sectional  regression  employed 
assumes  that  the  underlying  pool  of  firms 
does  not  change.  There  is  significant  turn¬ 
over  in  high-technology  industries  with  firms 
both  entering  and  exiting  the  market.  The 
non-significant  difference  between  1994  and 
1997  may  have  resulted  from  the  ability  of 
acquiring  firms  to  select  from  a  relatively  di¬ 
verse  pool  of  targets  in  both  years.  Further 
studying  the  impact  of  acquisition  timing  on 
performance  represents  an  opportunity  for 
future  research. 

Conclusion 

In  regard  to  the  first  research  question, 
there  is  clear  evidence  that  firms  use 
acquisitions  as  a  tool  to  gain  access  to  tech¬ 
nology.  This  finding  has  implications  for 
acquisitions  of  U.S.  technology  firms  by 
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foreign  firms.  Only  national  security  and 
not  economic  security  reasons  provide 
grounds  for  disapproving  an  acquisition  by 
a  foreign  firm  under  the  Exon-Florio  for¬ 
eign  acquisition  law.  It  is  reported  that  the 
DoD  is  considering  cross-Atlantic  defense 
industry  consolidation  (Urwitz,  1999). 
Based  on  the  potential  technology  trans¬ 
fer  implications  and  the  demonstrated  dif¬ 
ficulty  in  predicting  post-acquisition  out¬ 
comes,  encouraging  cross-Atlantic  defense 
industry  consolidation  to  realize  cost  sav¬ 
ings  may  be  misguided. 

In  regard  to  the  second  research  ques¬ 
tion,  acquisitions,  on  average,  do  not  im¬ 
prove  acquiring  firm  stock  performance. 
Completed  analysis  indicates  that  several 
factors  are  correlated 
with  higher  post-acquisi¬ 
tion  stock  performance. 
However,  only  four  of  the 
factors  commonly  asso¬ 
ciated  with  acquisition 
performance  that  are  un¬ 
der  the  control  of  man¬ 
gers  appear  to  impact 
post-acquisition  stock 
performance.  First,  the 
acquisition  of  target  firms 
in  related  industries  ap¬ 
pears  to  improve  post-ac¬ 
quisition  performance. 
Second,  the  acquisition 
of  targets  that  remain  smaller  than  an  ac¬ 
quiring  firm,  but  are  still  of  a  sufficient 
size,  leads  to  higher  post-acquisition  per¬ 
formance.  Third,  acquiring  firms  that 
carry  lower  debt  levels  are  more  likely  to 
experience  higher  post-acquisition  perfor¬ 
mance.  Fourth,  acquisitions  completed 
using  tender  offers  lead  to  higher  perfor¬ 
mance.  Combined,  these  four  factors 
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explain  only  12  percent  of  the  observed 
variance  in  post-acquisition  performance. 
This  is  consistent  with  existing  acquisi¬ 
tion  research  that  in  general  explains  “less 
than  10  percent”  of  the  variance  in  the 
stock  performance  of  acquiring  firms 
(Sirower,  1997,  p.  158).  Clearly  the  dollar 
value  and  volume  of  acquisition  activity 
requires  a  better  understanding  of  this  phe¬ 
nomenon.  Therefore,  we  also  considered 
the  impact  of  external  factors  on  post¬ 
acquisition  stock  performance. 

External  factors  relating  to  an  acquir¬ 
ing  firm’s  industry  munificence  and  tim¬ 
ing  of  an  acquisition  explain  7.1  percent 
of  the  variance  in  post-acquisition  stock 
performance.  Stated  differently,  37.2  per¬ 
cent  of  the  explained  variance  in  the  cur¬ 
rent  study  is  due  to  external  factors  that 
are  beyond  direct  control  and  the  major¬ 
ity  of  variance  still  remains  unexplained 
after  including  the  most  common  factors 
in  M&A  research  in  our  model.  In  total, 
this  study  only  explains  19.1  percent 
(F  =  2.12;  p  =  .015)  of  the  variance  in 
post-acquisition  performance.  This 
means  that  the  majority  of  variance  in 
post-acquisition  stock  performance  re¬ 
mains  unexplained  and  suggests  that 
government  policy  aimed  at  influenc¬ 
ing  high-technology  M&A  activity  may 
be  misguided  since  any  government 
intervention  may  have  opposite  the  de¬ 
sired  effect.  Additionally,  antitrust  poli¬ 
cies  in  high-technology  industries  may 
be  less  relevant  because  the  high  rate 
of  technology  change  may  keep  firms 
from  establishing  and  exercising  mo¬ 
nopoly  powers. 

In  regard  to  defense  industry  con¬ 
solidation,  results  indicate  it  is  not  rea¬ 
sonable  to  expect  consolidation  will 
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achieve  significant  benefits  in  firm 
stock  performance.  Although  consider¬ 
ations  of  defense  industry  stock  perfor¬ 
mance  may  be  secondary  to  the  gov¬ 
ernments  interests  in  the  short-term,  it 
is  of  concern  in  the  long-term  because 
it  impacts  the  attractiveness  of  the  in¬ 
dustry  to  employees  and  investors.  The 
long-term  success  and  health  of  the  de¬ 
fense  industry  requires  attracting  the  best 
employees  (Defense  Science  Board, 
2000)  and  maintaining  the  ability  of 
defense  firms  to  utilize  the  capital 
markets.  However,  a  significant  portion 
of  high-technology  firm  employees  comes 
from  stock  options,  and  poor  performing 
defense  firms  would  be  less  able  to  attract 


and  retain  the  best  engineers.  Consider¬ 
ing  additional  performance  measures  for 
the  defense  industry  represents  an  opportu¬ 
nity  for  future  research. 

In  closing,  the  present  research  reviews 
current  post-acquisition  stock  perfor¬ 
mance  literature  to  test  factors  impacting 
the  post-acquisition  stock  performance  of 
firms  that  acquire  high-technology  targets. 
Results  of  the  study  show  that  internal  and 
extenal  factors  do  not  provide  a  clear 
guidance  for  managers  or  government 
policy  makers.  Additional  research,  es¬ 
pecially  focused  on  the  defense  industry 
and  its  unique  market,  is  needed  if  fac¬ 
tors  are  to  be  found  that  can  be  used  to 
influence  industrial  policy. 
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Appendix:  Research  Methodology 


This  appendix  describes  in  detail  the 
research  methodology  used  beginning 
with  the  sample.  The  discussion  of  the 
sample  is  followed  by  a  description  of 
the  operationalization  of  all  variables 
and  their  data  sources.  Finally,  the  sta¬ 
tistical  procedure  is  summarized. 

Sample 

The  sample  used  for  this  study  focused 
on  public,  high-technology  firms  that 
were  acquired  between  January  1,  1994 
and  December  31,  1997  and  had  a  mar¬ 
ket  capitalization  of  at  least  $10  million. 
This  focus  enabled  us  to  isolate  acquisi¬ 
tions  of  a  specific  type  and  to  avoid  study¬ 
ing  a  cross-section  of  merger  and  acqui¬ 
sition  (M&A)  activity  that  may  introduce 
extraneous  effects.  Additionally,  the  time 
frame  offered  control  over  known  impacts 
of  the  business  cycle  on  acquisition  ac¬ 
tivity  (Ramanujam  &  Varadarajan,  1989) 
by  ensuring  all  measurement  was  limited 
to  a  period  of  favorable  economic  condi¬ 
tions.  A  $10  million  market  capitalization 
restriction  is  consistent  with  the  lower 
bound  observed  in  previous  acquisition 
research  (e.g.,  Finkelstein,  1997; 
Ravenscraft  &  Scherer,  1987)  and  was 
intended  to  ensure  target  firms  were 
large  enough  to  impact  acquiring  firm 
performance. 

High-technology  target  firms  were 
identified  as  those  that  (1)  were  in  two- 
digit  Standard  Industrial  Classification 
(SIC)  code  industries  commonly  recog¬ 
nized  as  high-technology,  and  (2)  dis¬ 
played  moderate  research  and  develop¬ 
ment  (R&D)  intensity  prior  to  being  acquired. 


Existing  literature  commonly  recognizes 
seven  two-digit  industry  sectors  as  high- 
technology  industries:  Chemicals  [28], 
Computer  Equipment  [35],  Electronics 
[36],  the  aerospace  industry  [Transporta¬ 
tion:  37],  Instruments  [38],  Communica¬ 
tions  [48],  and  the  software  industry  [Busi¬ 
ness  Services:  73]  (e.g.,  Certo,  Daily,  & 
Dalton,  2001).  Moderate  R&D  intensity 
was  operationally  defined  as  R&D-to- 
Sales  of  two  percent  or  greater.  This  value 
was  based  on  rounding  up  from  what  has 
been  reported  as  the  overall  industry  av¬ 
erage  R&D-to-Sales  figure  of  1.5  percent 
(e.g.,  Ravenscraft  &  Scherer,  1987).  This 
enabled  us  to  conservatively  and  objec¬ 
tively  identify  target  firms  as  reasonably 
R&D  intensive  without  unduly  restrict¬ 
ing  the  sample.  After  applying  these 
screens,  a  census  of  312  high-technology 
firms  was  identified. 

To  identify  the  final  sample,  however, 
two  additional  restrictions  were  applied. 
First,  acquisitions  were  eliminated  if  the 
target  and  acquiring  firms’  SIC  codes 
were  not  identified  by  COMPUSTAT  to 
the  four-digit  SIC  level.  This  controlled 
for  industry  effects  and  allowed  the  use 
of  a  categorical  entropy  diversification 
measure  for  firm  relatedness.  It  also 
offered  the  benefit  of  controlling  for 
potential  confounding  effects  of  conglom¬ 
erate  firms.  Second,  acquiring  firms  had 
to  be  available  in  the  Center  for  Research 
on  Security  Prices  (CRSP)  database  to  al¬ 
low  us  to  calculate  several  of  our  measures 
(e.g.,  Jensen’s  alpha,  the  premium  paid, 
and  relative  size).  The  final  sample 
includes  133  firm  pairs. 
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Measures  and  abnormal  returns  to  be  observed 

This  section  explains  the  operationali-  (Campbell,  Lo,  &  MacKinlay,  1997). 

zation  for  each  variable  beginning  with  Individual  firm  stock  and  market  bench- 

the  dependent  stock  performance  vari-  mark  monthly  rates  of  return  were  col- 

able,  and  then  the  explanatory  variables  lected  from  the  CRSP  database  with  the 

in  the  order  they  are  discussed  in  the  pa-  S&P500®  index  serving  as  the  market 

per.  benchmark. 

Firm  Performance.  Jensen’s  alpha  Diversification.  The  relatedness  of  an 
(Alexander  &  Francis,  1986),  a  variation  acquisition  was  measured  as  a  categori- 
of  the  two-parameter  market  model,  was  cal  entropy  measure  (Hoskisson,  Hitt, 
used  to  measure  an  acquiring  firm’s  Johnson,  &  Moesel,  1993)  where  relat- 

performance.  For  each  month  after  an  edness  varies  based  on  the  degree  that 

acquisition  (t  =  1  to  36),  the  regression  target  and  acquiring  firm  primary  four- 

model  shown  in  Figure  1  was  calculated.  digit  SIC  codes  match.  An  unrelated  ac- 

As  the  regression  intercept,  Jensen’s  quisition  (value  =  0)  is  defined  as  the  ac- 

alpha  measures  the  average  difference  quisition  of  a  target  firm  in  a  four-digit 

between  the  market  benchmark’s  return  SIC  outside  an  acquiring  firm’s  two-digit 
and  the  return  of  the  firm  (Alexander  &  industry  group.  The  first  level  of  related 

Francis,  1986),  or  abnormal  return.  If  acquisitions  occurs  when  an  acquiring 

Jensen’s  alpha  is  not  significantly  differ-  and  target  firms  two-digit  industry  groups 
ent  from  zero,  then  a  firm’s  stock  perfor-  match  (value  =  1).  Similarly,  when  an  ac- 

mance  is  the  same  as  the  market  bench-  quiring  and  target  firms  SIC  code  matches 

mark.  Once  calculated  for  each  firm,  to  three-  and  four-digits  relatedness,  val- 
Jensen’s  alpha  is  used  as  the  dependent  ues  of  two  and  three  will  be  assigned  re¬ 
variable  in  a  cross-sectional  analysis  to  spectively. 

test  independent  variable  effects.  This  ap-  Relative  size.  The  relative  size  of 
plication  of  cross-sectional  analysis  al-  firms  was  calculated  similar  to  Sirower 

lows  the  association  between  an  event  (1997)  as  the  ratio  of  target  firm  market 


Ru  + 

where: 

Rit  is  the  monthly  rate  of  return  of  firm  i  during  month  t 
a  (.  is  Jensen’s  alpha  for  firm i 

(3 .  is  a  firm  i’s  stock  price  variance  relative  to  the  variance  of  the  market  benchmark  (m) 
Rmt  is  the  monthly  rate  of  return  of  the  market  benchmark  (m)  during  month  t 
s  it  is  the  random  error  term 

Figure  1.  Regression  Model 
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capitalization  divided  by  acquiring  firm 
market  capitalization.  Market  capitali¬ 
zation  was  calculated  from  either  the 
CRSP  or  Security  Data  Corporation 
(SDC)  database  four  weeks  prior  to  an 
acquisition  announcement. 

Acquisition  Experience.  Acquisition 
experience  was  operationalized  similar  to 
Hayward  (2002)  with  an  acquiring  firm’s 
acquisition  experience  recorded  as  the  sum 
of  a  firm’s  acquisitions  for  the  previous 
three  years.  Acquisition  experience  was 
measured  prior  high-technology  acquisi¬ 
tion  experience  of  an  acquirer  in  the  three 
years  prior  to  the  acquisition  of  interest. 

Method  of  Accounting.  The  method 
of  accounting  for  an  acquisition  was  mea¬ 
sured  by  using  a  dichotomous  dummy 
variable  (pooling  =  0  and  purchase  =  1). 
Information  on  method  of  accounting  was 
identified  from  either  the  SDC  database 
or  an  online  search  of  business  press. 

R&D  Expenditures.  An  acquirer’s 
R&D  expenditures  were  measured  using 
R&D  intensity  (Cohen  &  Levinthal,  1989, 
1990)  minus  the  average  R&D  intensity 
of  firms  in  its  industry  to  control  for 
industry  effects  (Dess,  Ireland,  &  Hitt, 
1990).  The  resulting  relative  R&D  inten¬ 
sity  measure  was  averaged  for  the  prior 
three  years  to  represent  a  firm’s  level  of 
commitment  to  developing  technological 
capability,  while  controlling  for  annual 
variation.  Firm  and  industry  R&D  inten¬ 
sity  were  calculated  using  data  available 
from  COMPUSTAT :  R&D  expenditures 
(data  code  46)  divided  by  sales  (data  code 
12).  Industry  R&D  intensity  was  calcu¬ 
lated  from  COMPUSTAT  by  calculating 
the  average  R&D  intensity  for  all  firms 
with  the  same  four-digit  SIC  code. 

Acquiring  Firm  Debt.  The  level  of 
an  acquiring  firm’s  debt  was  measured 


using  the  current  ratio.  It  was  calculated 
by  dividing  a  firm’s  current  assets  by 
its  current  liabilities  with  data  from 
COMPUSTAT  —  data  codes  4  and  5 
respectively. 

Form  of  Acquisition.  The  form  of 
acquisition,  merger  or  tender  offer,  was 
measured  using  a  dichotomous  dummy 
variable  (merger  =  0  and  tender  offer  = 
1).  Information  on  the  form  of  an  acquisi¬ 
tion  was  identified  from  either  the  SDC 
database  or  an  online  search  of  popular 
business  press. 

Target  Firm  Performance.  The  in¬ 
dustry  adjusted  profitability  of  a  target 
firm  was  measured  by  calculating  a  tar¬ 
get  firm’s  Return-on-Sales  (ROS)  in  the 
year  prior  to  its  being  acquired.  Profit¬ 
ability  was  measured  using  ROS  for  each 
firm  the  year  prior  to  an  acquisition,  and 
was  obtained  from  COMPUSTAT.  net  in¬ 
come  (data  code  172)  divided  by  sales 
(data  code  12). 

Firm  Environment.  A  firm’s  environ¬ 
ment  was  measured  using  the  three  en¬ 
vironmental  dimensions  of  munificence, 
dynamism,  and  concentration  computed 
at  the  four-digit  SIC  level  using  the  pro¬ 
cedure  described  by  Keats  and  Hitt 
(1988)  and  calculated  for  the  five  pre¬ 
ceding  years,  beginning  in  the  year  prior 
to  acquisition.  Succinctly,  munificence 
is  the  average  of  the  regression  coeffi¬ 
cients  of  a  four-digit  industry’s  net  sales 
and  operating  income  over  the  preced¬ 
ing  five-year  period.  Dynamism  is  the 
average  of  the  standard  errors  of  the  re¬ 
gression  slopes  for  the  two  munificence 
regression  equations.  Complexity  is  a 
market  concentration  measure  computed 
by  regressing  the  terminal-year  (i.e.,  year 
five)  market  shares  of  the  firms  in  a 
given  industry  on  these  firms’  initial-year 
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(i.e.,  year  one)  market  shares.  Note:  lower 
values  on  the  complexity  scale  signify 
higher  levels  of  complexity. 

Tuning  of  Acquisition.  The  year,  or  time 
impact,  of  an  acquisition  was  measured 


using  a  polychotomous  dummy  variable 
(1995  =  1,  1996  =  2,  and  1997  =  3)  with 
the  year  1994  serving  as  the  reference  cat¬ 
egory. 
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Analysis 


Analysis  of  Variance  (ANOVA)  was 
used  to  identify  the  significance  and  in¬ 
dividual  level  of  variance  explained  by 
independent  variables  (Bray  &  Maxwell, 
1985).  Supplemental  analysis  was  used  to 
determine  if  the  assumptions  (the  same  as 
regression)  of  analytical  technique  were 
met.  Graphs  of  error  terms  were  consis¬ 
tent  with  conclusions  that  the  are  normally 
distributed.  Further,  none  of  the  variable 
bivariate  correlations  exceeded  .5,  indicat¬ 
ing  that  multicollinearity  should  not  be 
a  concern  (Gujarati,  1995,  p.  335).  The 
data  from  independent  firms  over  dif¬ 
ferent  time  periods  were  combined  in  a 
cross-sectional  analysis,  and  would  not 


be  expected  to  exhibit  autocorrelation 
commonly  associated  with  time  series 
data  (see  Griffiths,  Hill,  &  Judge,  1993). 
However,  the  cross-sectional  analysis  of 
data  over  several  years  and  the  signifi¬ 
cant  difference  between  the  year  an  ac¬ 
quisition  was  made  may  indicate  a  vio¬ 
lation  of  the  constant  variance  assump¬ 
tion  (see  Griffiths,  Hall,  &  Judge,  1993). 
Supplementary  analysis  using  the 
Goldfeld-Quandt  F-test  showed  none  of 
the  year-year  and  full  model 
combinations  are  significant.  This  suggests 
that  variance  across  the  different  years 
is  homoskedastic,  or  displays  constant 
variance. 
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Endnotes 


1.  Please  see  the  Appendix  for  a  de¬ 
scription  of  the  study’s  methodol¬ 
ogy- 

2.  The  authors  were  unable  to  confirm 
that  Tinsley  was  ever  divested  from 
ASM  Lithography. 

3.  The  potential  implication  is  that  ex¬ 
isting  M&A  research  may  be  biased 
by  model  under-specification  (see 
Griffiths,  Hill,  &  Judge,  1993:  312). 

4.  The  Financial  Accounting  Standards 
Board  eliminated  pooling  of  inter¬ 
ests  accounting  and  modified  re¬ 
cording  of  goodwill  with  purchase 
accounting  for  all  acquisitions  com¬ 
pleted  after  July  1,  2001. 


5.  We  would  like  to  thank  Steven  L. 
Schooner  of  George  Washington 
University  Law  School  for  mak¬ 
ing  this  observation. 

6.  A  single  F-117  mission  can  ac¬ 
complish  today  what  95  sorties 
achieved  during  Vietnam  or  what 
4,500  B-17  bombers  achieved 
during  WWII  (Toffler  &  Toffler, 
1993). 
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OPINION 


WHY  THE  "T"  IH  SMART 

A  CONSTRUCTIVE  SYNERGY 


ETC  Michael  D.  Proctor,  USA  (Ret),  Amy  Posey-Macalintal, 
and  Dennis  Kulonda 

Department  of  Defense  (DoD)  simulation-based  acquisition  (SBA)  is  widely 
discussed  in  literature.  The  Army  offers  a  broad  vision  of  SBA  concept  in  the 
form  of  Simulation  and  Modeling  for  Acquisition,  Requirements,  and  Training 
(SMART),  accenting  not  only  the  Acquisition  process  but  also  essential 
contributions  from  the  Requirements  and  Training  communities.  This  research 
highlights  how  organizational  training  simulation  has  significantly  helped  the 
acquisition  process  beyond  the  confines  of  post-acquisition  training. 


Training  is  essential  to  the  successful 
fielding  of  any  new  weapon  system. 
As  a  part  of  the  system  life  cycle, 
the  value  of  training  is  well  established. 
Further,  the  training  community  is  well 
known  for  their  ability  to  contribute  to  the 
development  of  training  packages  for  new 
materiel  acquisitions.  This  research  reveals 
that  with  increased  realism,  training  simu¬ 
lations  may  now  provide  a  significant  and 
credible  resource  useful  to  acquisition 
managers,  which  goes  beyond  training 
packages. 

The  research  investigates  the  hypotheses 
that  an  organizational  training  simulation 
may  support  materiel  acquisition  and, 
likewise,  materiel  acquisition  may  support 
organizational  training  simulation  devel¬ 
opment.  Using  a  case  study  methodol¬ 
ogy,  the  research  reveals  how  the  Close 


Combat  Tactical  Trainer  (CCTT)  training 
simulation  played  a  critical  part  in  the 
Battlefield  Combat  Identification  System 
(BCIS)  acquisition  as  well  as  how  the 
BCIS  advanced  the  CCTT. 

This  paper  presents  archival  record, 
experimentation,  cost,  interview,  and  sur¬ 
vey  highlights  from  the  case  study  as  well 
as  discusses  the  Simulation  and  Model¬ 
ing  for  Acquisition,  Requirements,  and 
Training  (SMART)  approach  to  acquisi¬ 
tion.  The  SMART  approach,  in  part, 
advocates  an  explicit  strategy  to  integrate 
training  simulation  in  acquisition  where 
appropriate.  Additionally,  this  paper  also 
identifies  tenets  that  may  promote  a 
synergistic  and  mutually  beneficial 
relationship  between  training  simulation 
and  materiel  acquisition.  Finally,  the  case 
study  identifies  process  mechanisms  that 
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may  help  insure  up-to-date-training 
systems  are  available  when  new  equipment 
systems  are  fielded  or  possibly  tested. 

Employing  Training  Simulation  in 
the  Acquisition  Process 


Simulation-based  acquisition  as  pur¬ 
sued  by  Department  of  Defense  (DoD)  is 
widely  discussed  in  literature  and  confer¬ 
ence  activities.  The  use  of  simulation  in 
the  system  life  cycle  continues  to  grow. 
Managers  report  gains  in  terms  of  quality, 
productivity,  and  performance  as  well  as 
reductions  in  cost,  cycle  time,  lag  time, 
and  risk.  This  success  has  not  come  about 
by  chance,  but  rather  by  planned  and 


deliberate  actions  by  astute  acquisition 
managers.  A  few  examples  are  referenced 
below  (Zittel,  2001;  Brantley,  McFadden, 
&  Davis,  2002;  Garber,  2001;  Johnson, 
McKeon,  &  Szanto,  1998;  Sanders,  1997). 

The  Army  and  its  simulation  action 
agent,  the  Army  Modeling  and  Simulation 
Office,  promote  a  version  of  simulation- 
based  acquisition  called  SMART  (Ellis, 
Kern,  &  Hollis,  2002;  Lunceford, 
2002).  SMART  is  more  than  semantics. 
SMART  emphasizes  not  only  the  essen¬ 
tial  acquisition  process,  but  also  the 
quality  enhancing  contributions  of  the 
training  and  requirements  communities 
to  that  process. 

For  the  Army,  a  key  vehicle  for  suc¬ 
cess  has  been  the  Simulation  Support 
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Figure  1.  Selected  Program  Events  and  Levels  off  Modeling 
and  Simulation  from  Functional  Areas 
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Plan,  (Ellis,  et  al.,  2002).  A  Simulation 
Support  Plan  provides  a  means  of  de¬ 
veloping  a  roadmap  of  simulation  inte¬ 
gration  within  the  life  cycle  of  a  system 
acquisition. 

The  Simulation  Support  Plan  is 
the  plan  identifying  utilization  of 
models  and  simulations  over  the 
lifecycle  of  an  acquisition  pro¬ 
gram  from  concept  and  technol¬ 
ogy  development  to  system 
disposal.  It  is  a  document  that 
evolves  as  the  system  matures. 
Because  SMART  is  an  enabler 
to  the-meeting  Army  Transfor¬ 
mation  objectives,  the  Simula¬ 
tion  Support  Plan  will  discuss 
how  SMART  is  implemented  in 
the  program.  (Ellis,  et  al.,  2002, 
p.  69) 

One  notional  representation  of  the 
source  and  level  of  simulation  contribu¬ 
tion  across  the  system  life  cycle  is  shown 
in  Figure  1.  Some  key  events  in  the  life 
cycle  are  also  noted  for  reference  pur¬ 
poses.  In  the  SMART  concept,  the  Inte¬ 
grated  Concept  Team  and  the  Integrated 
Product  Team,  under  the  leadership  of 
acquisition  managers,  interweaves  the  use 
of  models  and  simulations  into  the  system 
life  cycle.  The  team  plans  and  schedules 
activities  that  lead  to  successful  materiel 
acquisition. 

Thi  Hypotheses  of  Mutual  Benefit 

Not  clear  in  the  literature  is  the  contri¬ 
bution  that  organizational  training  simula¬ 
tions  may  make  to  the  acquisition  process 
or  the  contribution  the  acquisition  process 


may  make  to  organizational  training  simu¬ 
lations.  By  the  term  organizational  train¬ 
ing  simulation,  we  are  referring  to  a  com¬ 
position  of  various  simulation  systems  that 
attempt  to  represent  a  military  organiza¬ 
tion  for  organizational  training  purposes. 
For  the  Army,  the  CCIT  is  one  example. 
The  Distributed  Mission  Trainer  is  an 
example  for  the  Air  Force. 

What  is  significant  is  that  organiza¬ 
tional  training  simulations  go  beyond 
stand-alone  simulators  to  encompass  a 
composite  of  the  various  systems  found 
in  the  organization.  Simulation  of  an  or¬ 
ganization  potentially  enables  savings 
based  on  scale  rather  than  simply  sav¬ 
ings  gained  through  direct  one-to-one, 
simulator-to-system  simulation. 

Our  hypothesis  is  that  not  only  can  these 
organizational  training  simulations  help, 
primarily  through  the  advantages  of  scale, 
a  weapon  system  development  during  its 
life  cycle,  but  also  outflow  from  the 
weapon  system  development  may  advance 
model  fidelity  within  the  organizational 
training  simulation. 

Synergy  between  the  Two 


From  a  theoretical  perspective,  simu¬ 
lation  success  hinges  on  software  devel¬ 
opment  factors  identified  by  McCabe 
(1980)  and  listed  below. 

Fidelity:  the  accuracy  of  the  represen¬ 
tation  when  compared  to  the  real  world 
for  the  applications  that  it  was  intended. 

Modularity:  allowing  a  program  to  be 
created  from  individual  modules. 

Expandability:  allowing  the  expan¬ 
sion  of  requirements  for  storing  data 
and  scalability  in  computing. 
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Self-Descriptiveness:  clarity  in  terms 
of  explaining  how  a  system  works  through 
easy  to  use  Graphical  User  Interfaces 
(GUIs)  and  tools,  visibility  of  behaviors 
and  models,  documentation,  and  self¬ 
descriptiveness  of  code. 

Self-Explanatory:  ability  to  under¬ 
stand  model  output. 

Software  System  Independence: 
shows  how  much  a  program  depends  on 
its  computational  system  as  well  as 
reduces  the  burden  on  human  support 
personnel. 

Interoperability:  allowing  the  use  of 
standard  communications  protocols  so  that 
it  can  work  with  other  simulations. 

Data  Commonality:  allowing  the  rep¬ 
resentation  of  data  in  a  standard  form  that 
is  applicable  across  all  domains  and 
promotes  reuse. 

Our  formal  research  survey,  of  selected 
(from  industry  and  government)  simula¬ 
tion  professionals  iden¬ 
tified  by  the  Director  of 
the  Army  Modeling  and 
Simulation  Office,  re¬ 
vealed  that  of  the  above 
factors  Self-Descriptive¬ 
ness,  Interoperability, 
and  Data  Commonality 
were  statistically  ranked 
higher  in  importance  in 
terms  of  creating  ca¬ 
pable  and  reusable  mod¬ 
els  and  simulations  (Wilcoxon  Signed 
Rank  Test,  p  =  .1). 

That  is  to  say,  leading  simulation  pro¬ 
fessionals  view  interoperability  and  data 
commonality  along  with  self-descrip¬ 
tiveness  as  the  most  significant  factors 
in  terms  of  simulation  capability  and  re¬ 
usability.  Further,  funding  priorities 
within  the  simulation  community  reflect 


j.  "from  the 
acquisition 
porspocthro, 
interoperability 
I  ami  data  com- 
|  monallty  may 
prove  very 
helpful." 


that  importance.  For  example,  over  the 
past  decade,  the  Defense  Modeling  and 
Simulation  Office  funded  and  created: 
(1)  the  High  Level  Architecture  for  simu¬ 
lation  interoperability  and  (2)  Synthetic 
Environment  Data  Representation  and 
Interchange  Specification  toward  data 
commonality. 

From  the  acquisition  perspective, 
interoperability  and  data  commonality 
may  prove  very  helpful.  For  example,  a 
Program  Manager  of  a  new  system  devel¬ 
opment  may  leverage  interoperability  and 
data  commonality  investments  by  taking 
advantage  of  the  scale  implications.  Spe¬ 
cifically,  interoperability  and  data  com¬ 
monality  enable  composition  of  simula¬ 
tion  systems  involving  scores,  if  not 
hundreds,  of  synthetic  entities. 

While  emphasizing  interoperability 
and  data  commonality,  the  simulation 
community,  based  on  our  survey,  may  not 
emphasize  model  fidelity  as  strongly  as 
they  do  other  simulation  attributes.  This 
may  result  in  the  acquisition  community 
having  models  of  new  systems  that  are  of 
insufficient  fidelity  to  realize  the  benefits 
and  savings  of  the  SMART  approach  to 
system  acquisition.  From  an  acquisition 
perspective  that  infers,  with  the  advent  of 
a  new  materiel  system,  the  burden  of 
model  development  for  the  new  materiel 
rests  with  the  acquisition  manager. 

Compounding  the  possible  fidelity 
shortfall  of  models  for  new  materiel  in  an 
organizational  training  simulation  is  the 
need  for  increasing  fidelity  of  the  new 
model.  This  is  brought  out  in  part  by  the 
data  evolution  phenomenon  identified  by 
Ellis,  et  al.  (2002)  and  shown  in  Figure  2. 
As  systems  develop  over  time,  data  re¬ 
quirements  experience  increasing  need 
for  higher  fidelity  and  greater  breath 
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Figure  2.  Growing  Requirement  for  Fidelity  and  Breath 
in  the  Distributed  Product  Description 


while  expanding  to  more  activities  dis¬ 
tributed  within  an  organization  and 
across  organizations.  Therefore,  exist¬ 
ing  models  of  new  materiel  acquisitions 
sufficient  for  stand-alone  analysis  may 
need  further  refinement  to  be  suitable 
in  an  organizational  context. 

The  U.S.  Army  Program  Executive 
Office  for  Simulation,  Training,  and 
Instrumentation  maintains  that  synthetic 
environment  enhancements  can  occur 
concurrent  with  weapon  system  develop¬ 
ment.  This  may  happen  as  model  fidelity 
enhancements  are  funded  so  as  to  enable 
representation  of  a  new  weapon  system 
phenomenon.  Hence  the  state  of  simula¬ 
tion  may  advance  along  with  weapon 
system  development  as  implied  by  the 
Snake  Chart  in  Figure  3.  The  key  elements 
of  this  chart  are  the  two  development  lines 
(simulation  environment  and  weapon 
system)  interwoven  by  a  line  that  snakes 
from  one  development  effort  to  the  other. 
The  winding  of  the  Snake  represents  the 


flow  of  insights,  deliberately  common 
databases,  algorithms,  software  routines, 
architectures,  processes,  etc  from  one 
development  effort  to  the  other  over  time. 
The  flow  emphasizes  the  feedback  into 
simulation  development  that  can  be 
accrued  during  the  materiel  acquisition 
(weapon  system)  development  and  vice 
versa.  For  example,  modeling  of  a  weapon 
system  in  a  simulation  may  yield  insights 
that  advance  the  state  of  the  weapons  sys¬ 
tem  development.  Likewise,  weapon  sys¬ 
tem  development  may  create  new  reus¬ 
able  weapon  system  models  and  simula¬ 
tions  for  future  simulation  system  devel¬ 
opment,  thereby  promoting  synergy  be¬ 
tween  weapon  system  development  and 
synthetic  environment  development. 

Program  Descriptions 

To  examine  the  hypothesis  of  mutual 
benefit,  a  case  study  needed  to  have  an 
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Simulation  and  Modeling  for  Acquisition, 
Requirements,  and  Training  (SMART) 
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Figure  3.  "Snake  Chart" 


organizational  training  simulation  and 
a  materiel  acquisition  system  interact  as 
described  above  (Yin,  1994).  For  this 
research,  the  materiel  system  called  the 
BCIS  managed  by  Product  Manager, 
Combat  Identification  was  identified  as 
the  acquisition  program.  The  CCTT  simu¬ 
lation  was  identified  as  the  organizational 
training  simulation  system.  These  two 
systems  interacted  with  each  other  during 
the  BCIS  acquisition. 

The  CCTT  is  the  first  virtual  simula¬ 
tion  training  system  developed  under  the 
Combined  Arms  Tactical  Trainer  (CATT) 
program  (Figure  4).  The  CATT  is  acquir¬ 
ing  a  group  of  high-fidelity,  interactive, 
manned  simulators  for  training.  The  CATT 


program  provides  command,  control, 
and  communications  workstations,  and 
exercise  control  stations.  After  Action 
Review  systems  and  the  Virtual  Com¬ 
bined  Arms  synthetic  environment  to 
support  virtual  training  organizations  up 
to  battalion/task  force  level. 

Using  interoperability  and  data  com¬ 
monality,  the  CCTT  system  trains  tank  and 
mechanized  infantry  organizations  from 
platoon  to  battalion  task  force,  including 
cavalry  scout  platoons  and  heavy  cavalry 
troops  on  collective  tasks.  The  CCTT  sys¬ 
tem  offers  commanders  the  opportunity  to 
develop  and  tailor  structured  exercises 
based  on  mission,  enemy,  troops,  terrain, 
and  time  available  to  meet  the  training 
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__ #  _  Courtesy  of  Lockheed  Martin  Corporation 

Figure  4. 

Training  in  the  Close  Combat  Tactical  Trainer  Virtual  Environment 


plan  and  objectives  of  the  organization 
(Figure  5).  CATT  virtual  synthetic  environ¬ 
ment  includes  large-scale  virtual  terrain  rep¬ 
resentation  with  natural  synthetic 
environment  effects  (e.g.,  weather  effects), 
accredited  computer  generated  forces 
replicating  adjacent,  supporting,  and 
opposing  forces  (Barlow,  2003). 

Part  of  the  Combat  Identification  pro¬ 
gram,  theBCIS,  is  a  millimeter  wave  device 
that  is  integrated  into  the  vehicle  subsystems 
to  aid  in  target  identification.  The  intent  of 
the  device  is  to  reduce  fratricide  (friend  on 
friend  combat  engagement).  The  BCIS  at¬ 
tempts  to  reduce  fratricide  by  identifying  at 
the  gunner’s  sights  contacts  as  friendly  if 
the  contact  is  equipped  with  the  BCIS  or 
UNKNOWN  if  otherwise.  The  BCIS  works 
effectively  through  smoke,  dust,  sand,  rain, 
fog,  and  beyond  visual  range.  A  typical 


BCIS  event  occurs  with  Abrams  or  Bradley 
platforms  interacting  with  other  friendly  and 
opposing  combat  vehicles  as  well  as  non- 
combatant  vehicles  (Maddux,  Kwiecien,  & 
DeChiaro,  2001;  J.  Tomasello,  personal 
communication,  May  1,  2002). 

Mutual  Benefit 


Operational  testing  of  the  BCIS  was 
needed  in  order  to  assist  the  U.S.  Army  in 
making  an  acquisition  decision.  A  tradi¬ 
tional  approach  to  such  testing  would  be 
to  conduct  a  live  exercise  in  the  field  using 
real  vehicles  equipped  with  BCIS. 
Because  of  the  investments  of  the  simu¬ 
lation  community  in  interoperability  and 
data  commonality,  an  alternative  to  live 
field-testing  existed  in  the  Close  Combat 
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Courtesy  of  Evans  &  Sutherland 


Figure  5.  Screen  Shot  from  Close  Combat  Tactical  Trainer  Simulator 


Tactical  Training  system.  Using  an  or¬ 
ganizational  training  simulation  to  re¬ 
place  an  operational  test  is  innovative 
as  well  as  not  typically  considered  at 
this  stage  of  the  system  life  cycle.  Yet, 
due  to  a  creative  approach,  this  alterna¬ 
tive  was  allowed  to  develop. 

J.  Tomasello  (personal  communication. 
May  1,  2002),  winner  of  a  SMART  2002 
award  for  his  efforts  (Lunceford,  2002), 
clarifies  the  two  choices: 

The  goal  was  to  determine  if 
Battlefield  Combat  Identification 
System  made  a  greater  contribu¬ 
tion  than  other  situational  aware¬ 
ness  equipment  choices.  For  the 
operational  component  of  the 


assessment,  [Program  Manager] 
PM  Combat  Identification  had  the 
choice  of:  (1)  going  to  the  Nation¬ 
al  Training  Center  and  standup  a 
battalion  force  of  combat  vehicles 
with  the  equipment  to  be  tested 
or  (2)  utilizing  the  Close  Combat 
Tactical  Trainer  facility  at  Ft. 
Hood,  Texas  for  the  operational 
evaluation.  (J.  Tomasello,  per¬ 
sonal  communication,  May  1, 
2002) 


The  estimated  cost  of  pursuing  a  live 
field-operational  test  was  approximately 
$20  million  (J.  Maddux,  personal  commu¬ 
nication,  n.d.,  2003).  For  case  study  re¬ 
search,  Yin  (1994)  indicates  that  archival 
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records  are  a  source  of  evidence  to 
explain  or  provide  context  for  such  case 
evidence.  As  such,  General  Accounting 
Office  (GAO)  reports  can  provide  some 
insight  as  to  the  validity  of  this  $20  mil¬ 
lion  dollar  estimate.  While  recent  GAO 
estimates  do  not  delineate  actual  exer¬ 
cise  costs  at  the  National  Training  Cen¬ 
ter,  they  do  indicate  that  the  Army 
spends  more  than  a  $1  billion  annually 
to  provide  training  for  123  battalion  at 
its  three  Combat  Training  Centers 
(Schuster,  1999).  This  includes  far  less 
expensive,  non-mechanized  battalion 
rotations  at  the  Joint  Readiness  Train¬ 
ing  Center.  Nonetheless,  that  is  still  ap¬ 
proximately  $8.1  million  per  battalion 
in  FY  1998  dollars  or  $8.8  million  in 
FY  2001  dollars. 

The  last  reported  GAO  cost  estimates 
for  unit  costs  for  mechanized  battalion 
training  at  the  National  Training  Center 
is  $4  to  $6  million  per  unit  for  1983  to 
1985  ($7.1  to  $10.6  million  2001  dollars 
using  the  Bureau  of  Labor  Statistics 
Inflation  calculator  http://www.bls.gov/ 
cpi)  (Conahan,  1986).  These  figures  do  not 
include  National  Training  Center  operat¬ 
ing  and  instrumentation  costs,  which 
would  be  prorated  across  the  number  of 
units  training  on  an  annual  basis.  The 
GAO  reports  that  those  costs  ranged  from 
$62  to  $90  million  annually  for  the  1983 
to  1985  period  (Conahan,  1986).  Addition¬ 
ally,  the  GAO  estimates  do  not  include  low 
rate  production  costs,  equipment  up¬ 
grades,  and  other  associated  costs  neces¬ 
sary  to  actually  implement  a  field  test 
using  BCIS  equipment.  In  this  context,  a 
$20  million  estimate  for  BCIS  testing  does 
not  appear  to  be  unreasonable. 

On  the  other  hand,  the  total  cost  for  con¬ 
ducting  BCIS  testing  in  CCTT  actually 


came  to  approximately  $2  million.  That 
cost  included  related  modeling  efforts, 
incorporation  of  models  within  CCTT 
environment,  expanding  the  data  collec¬ 
tion  and  reduction  capabilities,  and  per¬ 
forming  data  analyses  (J.  Maddux,  per¬ 
sonal  communication,  n.d.,  2003).  The 
same  level  of  testing  was  achieved  with¬ 
out  imposing  on  the  National  Training 
Center.  Further,  the  potential  for  conduct¬ 
ing  additional  scenarios  and  events  not 
possible  in  a  live  setting  due  to  safety  and 
environmental  restrictions  was  possible. 
J.  Tomasello  (personal  communication, 
May  1,  2002)  explains  the  advantages. 


Even  though  configuring  the 
Close  Combat  Tactical  Trainer 
and  designing  the  evaluation  to 
replicate  the  different  options 
took  a  year  and  involved  the  co¬ 
operation  of  the  Army  Test  and 
Evaluation  Command  and  the 
Army  Materiel  Analysis  Activity 
(this  would  have  had  to  been  done 
anyway),  the  saving  from  not  hav¬ 
ing  to  modify  equipment,  operate 
it  in  the  field,  or  endanger  person¬ 
nel  during  real  operations  all  were 
savings  that  could  be  identified  in 
real  time.  Further,  the  collabora¬ 
tion  between  Developer,  Tester, 
and  Trainer  yielded  additional 
benefits  in  quality  improvements 
to  Battlefield  Combat  Identifica¬ 
tion  System  that  may  not  be  as 
easily  quantified.  The  results  were 
part  of  the  test.  The  data  were 
actually  used.  General  Kem  could 
say  Battlefield  Combat  Identifi¬ 
cation  System  does  reduce  the  in¬ 
cident  of  fratricide.  That  was  all 
done  in  the  simulation  as  part  of 
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the  operational  evaluation.  We 
could  readily  do  night,  fog,  and 
rain,  etc.  on  demand  that  Na¬ 
tional  Training  Center  could  not. 

(J.  Tomasello,  personal  commu¬ 
nication,  May  1,  2002) 

With  estimates  of  a  90  percent  cost  sav¬ 
ings,  lead-times  within  the  planning  cycle, 
and  with  increased  flexibility  and  capa¬ 
bility,  J.  Maddux  (per¬ 
sonal  communication, 
n.d.,  2003),  Product 
Manager  for  Combat 
Identification,  funded 
the  modeling  efforts  to 
represent  the  BCIS  in 
the  CCTT.  One  essen¬ 
tial  aspect  for  this  fund¬ 
ing  required  that  the 
BCIS  simulator  code, 
called  the  Battlefield  Identification  Sys¬ 
tem  Environment  and  Performance 
Simulator,  be  put  in  the  CCTT  code.  J. 
Tomasello  (personal  communication, 
May  1,  2002)  indicates  how  that  was 
done: 

Georgia  Tech  Research  Institute 
developed  the  Battlefield  Identi¬ 
fication  System  Environment  and 
Performance  Simulator,  initially 
a  server  based  application  that 
replicated  what  happened  when 
you  probe  somebody  with  the 
Battlefield  Combat  Identification 
System  millimeter  wave  system. 

We  took  the  Battlefield  Identifi¬ 
cation  System  Environment  and 
Performance  Simulator  off  the 
server  and  embedded  Battlefield 
Identification  System  Environ¬ 
ment  and  Performance  Simulator 


into  Close  Combat  Tactical 
Trainer  code.  We  designed  the 
software  so  it  was  distributed  to 
the  manned  modules  and  re¬ 
moved  the  server  as  a  single 
point  of  failure.  (J.  Tomasello, 
personal  communication  May 
1,  2002) 

This  enabled  the  CCTT  to  support  test¬ 
ing  of  the  Battlefield  Combat  Identifica¬ 
tion  System.  Trials  were  conducted  and 
the  Army  Test  and  Evaluation  Command 
and  the  Army  Materiel  Analysis  Activity 
utilized  the  accredited,  simulated  battle 
trials  generated  in  theCCTT  in  their  test 
and  evaluations  plans,  replacing  the  live 
simulation  trials  that  were  avoided. 

A  Smart  Approach  to  Acquisition 

One  of  the  key  lessons  learned  from  this 
case  study  is  the  SMART  approach  taken 
by  the  key  leaders.  Elements  of  that 
approach  include  innovation,  leadership, 
collaboration,  and  an  active  involvement 
of  the  Integrated  Product  Team  with  the 
goal  of  wisely  using  all  possible  simula¬ 
tion  alternatives.  PM  innovation  and  cre¬ 
ativity  was  paramount  to  taking  on  the  risk 
of  providing  resources  to  pursue  the 
unproven  route  of  using  organizational 
training  simulations  to  replace  operational 
field  testing.  In  essence,  PM  Combat  Iden¬ 
tification  took  advantage  of  the  opportu¬ 
nity  by  being  open  to  this  non-traditional 
approach. 

Leadership  was  essential  by  both  the 
PM  Combat  Identification  and  PM  CATT 
in  order  to  capitalize  on  the  opportunity. 
Collaboration  was  the  means  by  which 
things  were  accomplished.  PM  Combat 


"Om  of  flie 
key  lessens 
learned  from 
this  case  study 
Is  the  SMART 
approach  taken 
by  the  key 
leaders." 
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Identification  and  PM  CATT  cultivated 
collaboration  across  their  organizations 
and  participants  from  the  Army  Test  and 
Evaluation  Command,  the  Army  Mate¬ 
riel  Analysis  Activity,  III  Corps, 
Lockheed  Martin,  Science  Applications 
International  Corporation  (SAIC),  DSCI, 
Pulau  Electronics,  and  Georgia  Tech 
Research  Institute  through  their  leader¬ 
ship  of  the  Integrated  Product  Team.  In 
the  words  of  Mr.  J.  Tomasello  (personal 
communication,  May  1,  2002): 


The  SMART  process  changes  are 
major.  What  SMART  does  is 
break  barriers  down  giving  every¬ 
one  a  common  goal.  Collabora¬ 
tion  is  of  the  utmost  importance. 
For  a  process  team,  you  have  got 
to  agree  from  the  start,  what  your 
objectives  are,  what  your  require¬ 
ments  are.  (J.  Tomasello,  personal 
communication,  May  1,  2002) 


Expanding  on  these  insights,  coopera¬ 
tion  between  the  acquisition  community 
and  the  training  system  development  com¬ 
munity  also  makes  for  faster,  more  effi¬ 
cient  and  effective  transition  of  high- 
fidelity,  software  updates  for  materiel 
systems.  J.  Tomasello  (personal  com¬ 
munication,  May  1,  2002)  explains  one 
process  mechanism  that  has  reduced 
training  simulation  software  lead-times. 


Scratching  the  surface  of  reuse 
and  SMART  is  our  basic  program 
for  our  M2A3  Bradley  Fighting 
Vehicle  and  M1A2SEP  Abrams 
Tank.  We  take  the  vehicle  soft¬ 
ware  and  have  it  modified  with  a 
wrapper  around  it  so  that  it  runs 
in  Close  Combat  Tactical  Trainer. 


When  General  Dynamics  (sys¬ 
tem  manufacturer)  puts  out  an 
update,  we  have  a  third  party  — 
OASIS  —  ...  deliver  the  code 
with  the  wrapper  to  CCTT  as  well 
as  Advanced  Gunnery  Training 
System,  the  Maintenance  Trainer 
and  the  Driver  Trainer.  It  is  a  li¬ 
brary  they  deliver  that  we  take  and 
drop  into  our  systems,  Close 
Combat  Tactical  Trainer,  manned 
modules,  everything.  The  big  ad¬ 
vantage  of  this  process  is  that  the 
tank  commander,  gunner,  loader, 
etc.  sees  the  latest  version  of  the 
software  in  Close  Combat  Tacti¬ 
cal  Trainer.  You  don’t  want  one 
version  of  the  interface  software 
being  fielded  with  the  weapons 
systems  and  another  version  of 
the  software  in  the  Close  Com¬ 
bat  Tactical  Trainer.  (J.  Tomasello, 
personal  communication.  May  1, 
2002) 


This  cooperation  between  the  materiel 
developer  and  the  organizational  training 
system  developer  enables  training  systems 
to  be  up-to-date  when  new  materiel  sys¬ 
tem  updates  reach  the  field.  This  process 
mechanism  may  also  make  it  possible  to 
conduct  future  operational  testing  in 
organizational  training  simulations  in  an 
even  more  rapid  fashion  then  occurred  in 
this  case  study. 

For  this  case  study,  leadership  found 
traction  through  creativity,  collaboration, 
capitalization,  and  cultivation  —  all  of 
which  may  be  considered  key  tenets  of 
SMART.  Future  acquisition  managers 
may  consider  promoting  cross-domain 
collaboration,  cultivation  of  a  life  cycle 
perspective  among  team  members,  and 
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capitalization  of  Modeling  and  Simula¬ 
tion  (M&S)  assets  in  order  to  achieve 
program  benefit. 


Conclusion 


With  increased  realism  and  the  ben¬ 
efits  of  scale  made  possible  by 
interoperability  and  data  commonality, 
organizational  training 
simulations  may  now 
provide  a  significant 
and  credible  resource 
useful  in  the  successful 
and  cost-effective  man¬ 
agement  of  a  materiel 
acquisition.  This  paper 
identifies  key  findings 
from  a  case  study  of  the 
use  of  an  organizational 
training  simulation  in  support  of  acquisition. 
A  brief  overview  of  the  possible  mutual  ben¬ 
eficial  relationship  between  organizational 
training  simulation  and  the  materiel  acquisi¬ 
tion  system  is  presented.  Examples  of  ex¬ 
plicit  strategies  of  employing  training  simu¬ 
lation  in  acquisition  and  tenets  to  accom¬ 
plish  these  benefits  are  proposed. 

PM  Combat  Identification  effectively  col¬ 
laborated  with  PM  CCTT  and  other 
organizations  to  create  benefit  for  both  pro¬ 
grams.  Essential  to  the  success  was  their  will¬ 
ingness  to  take  advantage  of  the  inherent 
attributes  of  the  systems  themselves.  They 
capitalized  on  the  scale  capabilities  of  the 
CCTT  to  represent  a  large  force  of  live  sys¬ 
tems.  Using  one  composite  system  to  rep¬ 
resent  many  resulted  in  significant  cost 
savings.  Secondly,  they  reused  the  BCIS 
existing  simulator  code  in  CCTT.  This  ac¬ 
tion  saved  both  time  and  money. 
Accompanying  the  resulting  cost  savings 


"The  acquisition 
manager  is  key 
to  achieving 
synergy  between 
training  Simula* 
tion  and  acquisi¬ 
tion  models...." 


and  feedback  to  BCIS  was  a  synergistic 
flow  of  insights,  deliberately  common 
databases,  algorithms,  software  rou¬ 
tines,  architectures,  processes,  etc.  to 
CCTT. 

Also  essential  to  the  success  of  this 
case  study  was  the  roadmap  of  simula¬ 
tion  integration  created  by  the  Integrated 
Product  Team.  Planning  is  necessary  not 
only  for  the  purpose  of  coordination,  but 
also  to  accommodate  lead  times  for 
simulation  integration.  In  particular,  this 
case  study  indicates  successful  planning 
includes:  creating  new  opportunities  by 
innovate  thinking  and  risk  taking;  cul¬ 
tivating  a  total  life  cycle  perspective  so 
as  to  maximize  the  potential  to  create 
benefit  throughout  the  life  cycle; 
emphasizing  collaboration  within  Inte¬ 
grated  Concept  Team  and  Integrated 
Product  Team,  and  capitalizing  on  ex¬ 
isting  models  and  simulation  systems 
within  these  communities,  to  include  the 
training  community. 

Simulation  of  a  large-scale  field  exer¬ 
cise  was  made  possible  through  training 
simulation  strengths  in  interoperability 
and  data  commonality.  The  acquisition 
manager  is  key  to  achieving  synergy 
between  training  simulation  and  acquisi¬ 
tion  models  by  addressing  the  need  for 
increasing  model  fidelity  over  time  as  it 
relates  to  the  materiel  development. 
Organizational  training  simulations  may 
not  have  the  priority  or  perspective  that 
materiel  acquisition  managers  have  to 
develop  high  fidelity  models  of  new 
materiel.  Thus,  the  responsibility  rests 
with  materiel  acquisition  managers  to 
develop  models  of  sufficient  fidelity  for 
analysis.  Existing  process  mechanisms 
that  currently  speed  the  transfer  of  model 
data  from  materiel  acquisition  systems 
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into  the  training  simulations  may  also  help 
speed  acquisition  model  data  into  train¬ 
ing  simulations  for  operational  testing 
purposes. 

Given  the  numerous  other  simulation 
systems  identified  by  the  earlier 
references,  the  use  of  organizational 
training  simulation  is  only  one  set  of 


tools  in  the  acquisition  community  arse¬ 
nal.  The  CCTT  is  one  of  those  tools.  Rais¬ 
ing  the  awareness  of  the  capabilities  of  the 
training  simulation  community  to  the  ac¬ 
quisition  community  is  important  for  the 
war  fighter,  who  will  reap  the  benefit  from 
these  successes. 
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LESSONS  LEARNED  FROM  THE 
EARLY  STAGES  OF  DEVELOPMENT  OF 
THE  GUARDRAIL  COMMON  SENSOR 
FOR  THE  RADICAL  REDUCTION 
OF  CYCLE  TIME 


i.  Daniel  Sherman 

Nine  key  participants  from  the  government  and  prime  contractor  were 
interviewed  to  identify  important  lessons  learned  from  the  early  stages  of 
development  of  the  Guardrail  Common  Sensor.  In  addition  to  in-depth  interviews, 
U.S.  Army  Communications  and  Electronics  Command  (CECOM)  historical 
documents,  unclassified  government  reports,  and  other  public  sources  were 
reviewed  for  information  regarding  the  system’s  development.  The  management 
of  the  system  development  deviated  from  normal  acquisition  processes  in 
several  important  ways.  These  are  presented  and  the  implications  for  flexibility 
in  the  acquisition  process  are  discussed. 


The  history  of  the  U.S.  Army  opera¬ 
tion  of  Special  Electronic  Mission 
Aircraft  (SEMA)  began  during  the 
Vietnam  War.  The  need  for  signal  intelli¬ 
gence  (SIGINT)  was  significant  during  the 
Vietnam  conflict,  and  as  a  consequence, 
improving  the  capability  of  these  systems 
became  an  important  Army  priority. 


Guardrail  Development  Prior  to 
Common  Sensor 


In  1970,  based  on  the  successful  devel¬ 
opment  of  ground-based  systems  in  Viet¬ 
nam,  the  National  Security  Agency  (NSA) 
under  the  guidance  of  its  director,  Admi¬ 
ral  Gayler,  initiated  the  development  of 
an  airborne  communications  intelligence 


This  study  was  funded  by  the  Army  Materiel  Command  (DAAH01-98-D-R001,  delivery  order  #67), 
Richard  G.  Rhoades,  Director,  Research  Institute,  University  of  Alabama  in  Huntsville,  and  William 
A.  Lucas,  Massachusetts  Institute  of  Technology  (MIT),  co-principal  investigators. 
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(COMINT)  system  with  more  advanced 
capabilities.  In  February  1971,  the  con¬ 
tract  was  awarded  to  Electronic  Systems 
Laboratories  (ESL),  a  division  of  TRW, 
for  the  development  of  what  would  be 
known  as  Guardrail  I  (Swainston,  1994). 

During  the  early  1970’s,  Guardrail  I 
was  followed  by  a  rapid  succession  of 
Guardrail  systems  that  included  Guardrail 
II,  III,  and  IV.  Guardrail  I-IV  (GR  I-IV) 
achieved  their  operational  requirements 
and  were  each  produced  on  schedule  and 
within  budget.  These  early  systems  were 
procured  by  NSA  as 
Quick  Reaction  Capabil- 
"TheTDOA  ity  (QRC)  programs, 

capabilities  of  They  were  designed  as 

GR/CS  would  give  theatre  level  assets  that 

•he  United  States  led  to  a  long-term  re- 

a  technology  quirement  for  Guardrail 

advantage  over  as  an  Army  Corps  level 

any  potential  asset.  In  early  1976,  the 

enemy/'  Guardrail  V  (GR-V)  pro¬ 

gram  was  conceived  and 
ESL  continued  the  pro¬ 
gram  as  prime  contractor.  The  GR-V  pro¬ 
gram  was  planned  as  a  cost-effective, 
second-generation  technology  insertion 
program.  In  1977,  as  a  result  of  the  Intel¬ 
ligence  Organization  and  Stationing 
Study,  responsibility  for  the  Guardrail 
program  was  transferred  from  NSA  to  the 
Department  of  the  Army,  Electronics 
Command  (ECOM,  later  to  be  Electron¬ 
ics  and  Communications  Command, 
CECOM;  Rawles,  1989). 

Unlike  the  contracts  for  GR  I-IV,  the 
GR-V  program  had  significantly  increased 
formal  data  requirements  in  the  areas  of 
logistics,  the  qualification  test  program, 
spare  parts  program,  quality  assurance 
program,  and  software  documentation. 
However,  GR-V  was  still  classified  as  a 


limited  production  urgent  system.  In  this 
sense,  while  GR-V  lost  some  of  the 
skunkworks-like  characteristics  of  GR  I- 
IV,  it  still  retained  the  authorization  to  pro¬ 
ceed  as  an  urgent  QRC  program  with  sig¬ 
nificantly  reduced  oversight  requirements 
(Moye,  1986;  D.  Swainston,  personal 
communication,  August  3,  2001). 

The  Guardrail  Common  Sensor 
Program 

In  1982,  while  the  improved  GR-V 
systems  were  being  completed,  a  concept 
began  to  emerge  for  an  advanced  system 
that  integrated  other  COMINT  and  elec¬ 
tronics  intelligence  (ELINT)  systems  with 
Guardrail.  This  would  be  known  as  the 
Guardrail  Common  Sensor  (GR/CS).  It 
would  combine  the  Advanced  Quicklook 
(AQL)  and  the  Communications  High 
Accuracy  Airborne  Location  System 
(CHAALS)  with  Guardrail  to  form  a  corps 
level  signal  intelligence  system  with  an 
integrated  platform  and  a  single  ground 
processing  facility  (R.  Sciria,  personal 
communication,  August  9,  2001). 

Development  of  the  Quicklook  ELINT 
system  (the  predecessor  to  AQL)  had 
begun  in  the  early  1970s.  With  GR/CS,  a 
new  generation  of  Quicklook  would  be 
developed  that  employed  the  technology 
known  as  Time  Difference  of  Arrival 
(TDOA).  This  technology  utilized  trian¬ 
gulation  from  multiple  aircraft  to  obtain 
location  coordinates  for  the  emanating 
source  of  a  radio  signal.  The  TDOA 
capabilities  of  GR/CS  would  give  the 
United  States  a  technology  advantage  over 
any  potential  enemy.  However,  in  order 
to  achieve  the  integration  for  the  GR/CS 
system,  the  AQL  would  require  miniatur¬ 
ization  due  to  weight  and  space  limita¬ 
tions.  The  contractors  for  the  Advanced 
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Quicklook  were  UTL  Corporation  in 
Dallas  (for  development)  and  Emerson 
Electronics  and  Space  Division  (ESCO) 
in  St.  Louis  (for  production).  The  second 
system  that  was  integrated  into  GR/CS 
was  the  CHAALS  precision  COMINT  lo¬ 
cation  system.  This  geolocation  system  for 
communications  emitters  utilized  both  the 
TDOA  technology  and  Differential  Dop¬ 
pler  technology,  and  International  Busi¬ 
ness  Machines  (IBM)  continued  as  the 
contractor  (CECOM,  1994;  Jette,  1996). 

The  basic  operational  concept  behind 
GR/CS  was  to  authorize  one  GR/CS  sys¬ 
tem  per  aerial  exploitation  battalion  in  the 
military  intelligence  (MI)  brigade  of  each 
corps.  A  standard  system  would  consist 
of  12  aircraft  that  would  fly  operational 
missions  in  sets  of  two  or  three.  The 
ground  processing  for  GR/CS  would  be 
conducted  in  the  integrated  processing 
facility  (IPF).  The  IPF  would  be  the  con¬ 
trol,  data  processing,  and  message  center 
for  the  overall  system.  It  consisted  of  four 
40-foot  trailers  with  28  operator  stations. 
Interoperable  data  links  would  provide 
microwave  connectivity  between  each  air¬ 
craft  and  the  IPF.  Reports  would  then  be 
transmitted  to  the  Commanders  Tactical 
Terminals  (CTT).  The  CTTs  would  be 
located  at  up  to  32  designated  intelligence 
centers  and  tactical  operations  centers.  The 
automated  addressing  to  CTT  field  termi¬ 
nals  would  provide  automated  message 
distribution  to  tactical  commanders  in  near 
real  time.  The  system  later  added  a  satel¬ 
lite  Remote  Relay  System  (RRS).  With 
this  system,  intercepted  SIGINT  data 
could  be  transmitted  to  any  location  in  the 
world  (CECOM,  1987, 1988;  Hall,  1990; 
U.S.  Army,  1994).  The  first  GR/CS  was 
completed  in  1991  and  throughout  the 
1990s  development  continued  with  an 


intensive  program  of  technology  insertion 
through  pre-planned  product  improvements. 


Lesson  1.  A  High  Technology 
Readiness  Level  Reduces  Risk 


A  number  of  important  factors  contrib¬ 
uted  to  the  success  of  the  Guardrail  pro¬ 
gram.  One  of  the  most  significant  factors 
that  influenced  budget,  technical  perfor¬ 
mance,  and  particularly  schedule  in  each 
phase  of  the  Guardrail  development  was 
the  level  of  technology  readiness  or  ma¬ 
turity.  When  the  pro¬ 
gram  started  in  the  early 
1970s,  ESL  had  already 
developed  an  extensive 
base  of  relevant  knowl¬ 
edge  among  its  engi¬ 
neering  staff  in  its  labo¬ 
ratories.  This  knowledge 
had  developed  through 
their  experience  with 
ground-based  remote 
COMINT  systems  in 
Vietnam.  In  addition,  at 
ESL,  other  Department 
of  Defense  (DoD)  pro¬ 
grams  provided  a  syn¬ 
ergy  in  the  development 
of  the  technologies  that  would  be  required 
for  Guardrail. 

The  extensive  base  of  expertise  at  ESL 
(and  later  CHAALS  expertise  at  IBM  and 
AQL  expertise  at  UTL  Corporation)  was 
only  one  contributor  to  the  level  of 
technology  readiness.  Another  important 
contributor  was  the  development  strategy 
that  was  first  instituted  at  NSA  and 
adopted  by  ESL,  and  later  adopted  by  the 
Army  program  offices.  This  development 
strategy  was  multidimensional,  but  one 


"One  of  the  most 
significant  factors 
that  influenced 
budget,  technical 
performance, 
and  particularly 
schedule  in  each 
/  phase  of  the 
Guardrail  devel- 
r  opment  was  the 
level  of  technol- 
ogy  readiness 
or  maturity." 
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key  element  was  a  focus  on  minimizing 
technological  risk  and  making  design  de¬ 
cisions  based  on  technological  maturity. 
However,  this  strategy  included  a  program 
of  systematic  pre-planned  product  im¬ 
provements  based  on  technology  insertion. 
The  technologies  in  areas  such  as  inte¬ 
grated  circuits,  direction  location  finding 
technology,  signal  pro¬ 
cessing  technology, 
computer  hardware  and 
software  were  evolving 
rapidly  during  this  pe¬ 
riod.  The  Guardrail  pro¬ 
gram  offices  and  ESL 
believed  that  as  each 
successive  system  was 
completed  and  fielded, 
the  next  system  could  be 
incrementally  upgraded 
as  a  new  generation 
Guardrail  system  with 
more  advanced  technology  (R.  Ohlfs,  per¬ 
sonal  communication,  August  6,  2001). 

The  laboratories  at  CECOM  also 
played  an  important  role  during  Guard¬ 
rail  development.  G.  Morris  (personal 
communication,  August  1,  2001)  of 
CECOM  noted  that  in  supporting  the 
CHAALS  and  the  Advanced  Quicklook 
programs  the  CECOM  laboratories  helped 
solve  numerous  technical  problems  that 
allowed  these  systems  to  mature  suffi¬ 
ciently  for  integration  into  the  Guardrail 
Common  Sensor. 

The  strategy  of  minimizing  technologi¬ 
cal  risk  and  making  design  decisions  based 
on  technological  maturity  worked  well 
throughout  the  1970s  and  1980s.  However, 
both  C.  Dubusky  (personal  communication, 
August  6, 2001)  of  the  Army  GR/CS  pro¬ 
gram  office  and  D.  Swainston  (personal 
communication,  August  3,  2001),  retired 


ESL  program  manager,  believed  that  the 
program  began  to  deviate  from  this  strat¬ 
egy  in  the  1990s.  With  GR/CS  System  2 
the  technological  envelope  began  to  be 
pushed  too  far,  too  soon.  This  resulted  in 
increased  levels  of  technological  risk,  and 
subsequent  problems  with  cost,  schedule, 
and  technical  performance.  This  is  perhaps 
a  lesson  in  organizational  learning  itself. 
Each  successive  generation  of  managers 
(both  government  program  office  and 
prime  contractor)  must  learn  from  the  suc¬ 
cessful  and  failed  decisions  of  preceding 
programs.  In  the  case  of  GR/CS  System 
2,  what  had  been  learned  in  the  past  in 
terms  of  development  strategy  seems  to 
have  been  forgotten. 

Lesson  2.  Utilizing  an 
Open  Architecture 


C.  Dubusky  (personal  communication, 
August  6,  2001),  chief  engineer  at  the 
government  project  office,  and  H.  Redd 
(personal  communication,  August  7, 
2001),  ESL  field  representative,  observed 
that  one  of  the  problems  projects  encoun¬ 
ter  in  areas  where  the  core  technologies 
are  advancing  rapidly  is  potential  for  the 
system  to  be  obsolete  before  it  is  ever 
fielded.  Because  Guardrail  was  becoming 
increasingly  software  dependent  with  each 
successive  generation,  to  address  this 
problem  the  Guardrail  government  pro¬ 
gram  office  and  ESL  instituted  two  initia¬ 
tives.  The  first  was  the  application  of  real 
time  tactical  system  processing  architec¬ 
ture  that  was  based  on  the  use  of  interna¬ 
tional  standards  and  the  use  of  a  seven 
layer  Ada  protocol.  The  second  initiative 
was  the  Advanced  Tactical  SIGINT 
Architecture  initiative  that  employed  a 


"The  strategy  off 
minimising  tech¬ 
nological  risk 
and  making 
design  decisions 
boned  on  techno¬ 
logical  maturity 
worked  well 
throughout  the 
1970s  and 
1980s." 
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unified  architecture  that  was  bus  oriented 
and  employed  all  Ada  software.  Thus,  the 
architecture  and  the  software  standards 
became  the  basis  for  the  system,  not  the 
vintage  of  computer  hardware.  As  new 
computer  and  bus  technology  were  intro¬ 
duced,  so  would  the  method  of  adapting 
to  the  established  standards.  In  this  way, 
as  computer  hardware  rapidly  evolved,  the 
software  for  successive  generations  of 
Guardrail  could  be  rapidly  adapted. 

It  should  also  be  noted  that  this  ap¬ 
proach  relied  heavily  on  commercial  off 
the  shelf  components  (COTS).  In  fact,  by 
the  time  GR/CS  System  1  was  being  pro¬ 
duced,  66  percent  of  1176  components 
were  commercial  off-the-shelf.  Further¬ 
more,  91  percent  were  common  with  other 
systems.  In  essence,  a  key  component  of 
the  acquisition  strategy  could  be  described 
as  evolutionary  acquisition.  A  core  capa¬ 
bility  is  fielded  with  a  modular  open  struc¬ 
ture  and  the  provision  for  future  incremen¬ 
tal  upgrades.  Each  successive  upgrade 
would  then  occur  as  a  block  of  pre-planned 
product  improvements  (R.  Ohlfs,  personal 
communication,  August  6,  2001;  D. 
Swainston,  personal  communication, 
August  3,  2001). 


Lesson  3.  The  Implementation 
of  a  Program 


In  the  context  of  the  Cold  War,  and 
under  conditions  of  rapid  technological 
advancements,  the  normal  acquisition  pro¬ 
cesses  were  viewed  to  be  inadequate  by 
the  Guardrail  program  office.  H.  Redd 
(personal  communication,  August  7, 2001), 
who  worked  for  the  government  program 
office  before  moving  to  ESL,  indicated 
that  based  on  the  failed  experience  of  the 


Communications  and  Electronics  Forward 
Looking  Flying  Lancer  (CEFLY  Lancer), 
program  office  staff  were  convinced  that 
a  radically  different  acquisition  strategy 
was  needed.  This  strategy  focused  on 
schedule  performance  and  consisted  of 
several  important  com¬ 
ponents.  First,  and  most 
importantly,  was  the  ap¬ 
proval  of  a  Quick  Reac¬ 
tion  Capability  program 
(QRC  program).  Given 
the  urgent  nature  of  the 
program,  and  the  fact 
that  top  Pentagon  offi¬ 
cials  were  convinced  of 
the  criticality  of  the 
schedule,  the  program 
office  was  able  to  obtain  a  letter  signed 
by  a  four-star  Army  general  and  a  four- 
star  admiral  (NSA)  approving  the  QRC 
program.  This  letter  was  later  referred  to 
as  the  “eight-star  letter,”  and  it  allowed 
the  program  office  maximum  flexibility 
to  modify  and  bypass  existing  acquisition 
processes. 

For  example,  one  of  the  factors  that 
contributed  to  the  schedule  and  cost  prob¬ 
lems  with  the  CEFLY  Lancer  was  the 
requirement  to  comply  with  extensive 
military  specifications.  S.  Pizzo  (personal 
communication,  August  28,  2001),  an 
engineering  manager  with  the  government 
program  office,  observed  that  the  Guard¬ 
rail  program  office  understood  that  the 
great  majority  of  these  elaborate  specifi¬ 
cations  would  not  be  critical  to  Guardrail’s 
performance,  maintainability,  reliability, 
etc.  However,  to  comply  with  such 
requirements  would  result  in  vastly  reduc¬ 
ing  the  ability  to  use  existing  off-the-shelf 
equipment  and  components.  This  would 
affect  schedule  and  cost.  In  other  words, 


I  "As  new 
computer  and 
bus  technology 
were  introduced, 
so  would  the  : 
method  of  adapt- 
|  Ing  to  the  estab¬ 
lished  standards." 
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the  incremental  benefit  associated  with 
many  of  the  specifications  could  not  be 
justified  based  on  the  schedule  and  cost 
implications.  With  the  approval  of  the 
QRC  reduced  cycle  time  program,  nu¬ 
merous  non-critical  milspecs  were  elimi¬ 
nated  or  modified. 

In  addition,  the  program  office  un¬ 
derstood  that  the  standard  Army  devel¬ 
opment  process  with 
the  usual  milestones 
and  approvals  would 
reduce  their  ability  to 
field  the  system  in  the 
time  parameters  that 
were  needed  in  the 
Cold  War  environment. 
In  light  of  this,  the 
QRC  program  allowed 
Guardrail  to  be  funded 
almost  completely  as  a 
production  program.  In 
actuality,  there  was  en¬ 
gineering  development 
occurring  as  the  program  progressed, 
but  it  was  funded  under  the  production 
contracts.  In  essence,  the  acquisition 
strategy  was  to  begin  with  the  baseline 
Guardrail  system  and  then  evolve  the 
system  through  blocks  of  pre-planned 
product  improvements  using  mature, 
but  state-of-the-art  existing  technology 
(C.  Dubusky,  personal  communication, 
August  6,  2001).  In  this  way  the  sched¬ 
uling  ramifications  associated  with  the 
standard  Army  acquisition  process  would 
be  reduced.  Of  course,  such  an  approach 
would  not  be  advisable  for  programs 
with  extensive  engineering  development 
requirements  or  large  production  runs. 
In  the  case  of  Guardrail,  this  approach 
worked  because  the  technology  was 
mature,  considerable  COTS  components 


could  be  used,  and  each  system  was 
comparatively  unique  or  customized. 

Former  ESL  Guardrail  program  man¬ 
ager,  T.  Black  (personal  communication, 
August  3, 2001),  observed  another  impor¬ 
tant  ramification  associated  with  the  use 
of  production  contracts.  Almost  all  of  the 
contracts  were  fixed  price  or  fixed  price 
plus  incentive  fee  contracts.  This  forced 
the  contractor  to  be  extremely  accurate  in 
cost  estimating  prior  to  program  start. 
Because  of  ESL’s  depth  of  expertise  in  all 
of  the  major  technologies,  cost  estimating 
was  generally  very  accurate. 

As  noted  previously,  while  engineering 
development  activity  was  included  in  the 
production  contracts,  it  was  not  funded 
in  the  usual  way  as  cost  plus  incentive  fee 
contracts.  C.  Dubusky  (personal  commu¬ 
nication,  August  6,  2001)  of  the  govern¬ 
ment  program  office  observed  that  this 
approach  to  the  acquisition  strategy  on 
the  part  of  the  government  resulted  in 
disciplined  cost  containment. 

Lesson  4.  When  the  Schedule 
for  Fielding  Is  Urgent 


S.  Pizzo  (personal  communication,  Au¬ 
gust  28,  2001)  of  the  Guardrail  program 
office  observed  that  the  assumption  that 
competition  in  defense  contracting  univer¬ 
sally  results  in  superior  performance  in 
terms  of  cost,  schedule,  and  technical  per¬ 
formance  may  be  incorrect.  Competition 
should  predictably  achieve  the  desired  re¬ 
sults  under  most  conditions.  However, 
there  are  conditions  under  which  the 
normal  competitive  process  in  government 
contracting  will  not  result  in  the  highest 
level  of  technical  and  schedule  performance. 


"...while 
engineering 
development 
ncthrity  was 
included  in  the 
production  con¬ 
tracts,  it  was  not 
funded  in  the 
usual  way  as  cost 
plus  incentive  fee 
contracts." 
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Guardrail  seems  to  have  been  one  of 
those  programs. 

When  the  schedule  for  fielding  is 
urgent,  the  technology  is  evolving  rapidly, 
and  the  defense  contractor  that  developed 
the  first  (baseline)  system  is  by  far  the 
leading  firm  in  terms  of  relevant  system 
specific  technical  expertise,  then  a  sole 
source  contract  may  be  required.  In  the 
case  of  Guardrail,  the  initial  contract  for 
Guardrail  I  was  competitive.  Thereafter, 
the  contracts  were  sole  source  to  ESL  as 
prime  contractor  (with  the  other  pertinent 
subcontractors).  This  resulted  in  several 
important  advantages  for  schedule  and 
technical  performance. 

First,  the  sole  source  contracts  for  the 
sequence  of  systems  following  Guardrail 
I  allowed  for  requirements  to  be  set 
through  dialogue.  The  usual  situation 
would  be  for  the  requirements  to  be  speci¬ 
fied  prior  to  a  request  for  proposals  (RFP). 
Thus,  requirements  would  be  set  in 
advance.  In  the  case  of  Guardrail,  ESL 
engineers  and  government  engineers 
worked  very  closely  to  develop  specifica¬ 
tions  for  each  successive  system  within 
the  general  requirements  specified  by 
the  Training  and  Doctrine  Command 
(TRADOC).  However,  TRADOC  gener¬ 
ally  deferred  to  the  judgment  of  the 
program  office,  and  this  allowed  for  speci¬ 
fications  to  be  developed  through  joint 
dialogue  between  engineers  at  ESL  and 
the  government  (D.  Swainston,  personal 
communication,  August  3,  2001). 

R.  Ohlfs  (personal  communication, 
August  6,  2001),  former  chief  systems 
engineer  at  ESL,  suggested  that  this  ap¬ 
proach  worked  well  because  ESL  could 
effectively  identify  requirements  that 
might  not  be  cost  effective  or  requirements 
that  could  adversely  affect  the  schedule. 


Thus,  the  dialogue  tended  to  influence 
the  process  so  that  design  decisions 
approached  the  optimum. 

Both  G.  Morris  (personal  communica¬ 
tion,  August  1,  2001)  of  CECOM  and  D. 
Swainston  (personal  communication,  Au¬ 
gust  3,  2001)  concluded  that  TRADOC 
contributed  to  the  requirements  stability 
and  funding  stability  of 
the  program.  This  was 
very  advantageous  to 
Guardrail  because  it  al¬ 
lowed  the  engineers  to 
work  in  an  environment 
that  minimized  dysfunc¬ 
tional  change.  When 
changes  or  new  capabili¬ 
ties  were  presented  by 
TRADOC,  the  Guardrail 
program  office  would  assess  the  techni¬ 
cal  feasibility  and  cost  implications  and 
introduce  the  change  in  the  next  succes¬ 
sive  generation  of  pre-planned  product 
improvements.  However,  TRADOC  basi¬ 
cally  deferred  to  the  judgment  of  the  tech¬ 
nical  experts  at  CECOM  and  ESL  as  to 
what  was  and  was  not  cost  effective  or 
technically  feasible.  In  this  way,  the  pro¬ 
gram  benefited  from  an  environment  of 
stability. 


"...the 

dialogue  tended 
to  influence  the 
process  so  that 
design  decisions 
approached  the 
optimum." 


Lesson  5.  Achieving  Effective 
Integration  for  the  Common  Sensor 


From  the  beginning  of  the  Guardrail 
program,  internal  integration  at  ESL  had 
been  managed  very  effectively.  ESL  had 
utilized  a  project-matrix  structure  with  a 
functional  engineering  organization.  The 
functional  areas  included  laboratories,  and 
the  organization  was  based  on  engineering 
specializations.  The  Guardrail  program 
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office  obtained  engineers  from  the  various 
functional  areas.  These  assignments  were 
typically  full  time  until  an  individual  was 
reassigned  to  another  project.  In  addition, 
the  laboratories  or  functional  groups 
would  provide  technical  support  to  the 
Guardrail  program  office  on  a  task-by-task 
basis  (R.  Ohlfs,  personal  communication, 
August  6,  2001). 

The  program  office  had  a  team  of 
assistant  program  managers  that  each 
managed  a  major  subsystem  or  functional 
area.  One  of  the  former 
ESL  program  manag¬ 
ers,  T.  Black  (personal 
communication,  August 
3,  2001),  indicated  that 
the  team  of  assistant 
program  managers  met 
on  a  near  daily  basis  be¬ 
cause  of  the  high  degree 
of  interdependency 
among  the  various  sys¬ 
tems.  To  keep  the  pro¬ 
gram  on  schedule,  pro¬ 
gram  evaluation  and  re¬ 
view  technique  (PERT) 
was  used  extensively,  and  schedules  were 
reviewed  weekly  on  a  task-by-task  basis. 
Even  before  concurrent  engineering 
became  common,  ESL  was  applying  the 
basic  processes  in  the  Guardrail  program 
(R.  Ohlfs,  personal  communication, 
August  6,  2001). 

Prior  to  Common  Sensor,  external 
coordination  with  the  various  subcontrac¬ 
tors  was  minimally  complex.  As  prime 
contractor,  ESL  assumed  responsibility  for 
system  integration.  With  the  advent  of  the 
Common  Sensor  and  the  addition  of  the 
CHAALS  and  AQL  systems,  integration 
increased  in  complexity.  ESL  and  the 
Guardrail  program  office  at  Ft.  Monmouth 


"To  keep  the 
program  on 
schedule,  program 
evaluation  and 
review  technique 
(PERT)  was  used 
extensively,  and 
schedules  wore 
reviewed  weekly 
on  a  task-by-task 
basis." 


developed  interface  control  documents  to 
specify  the  necessary  interfaces  with 
equipment  being  developed  and  produced 
by  IBM,  ESCO,  Beech,  Unisys,  UTL 
Corporation,  and  other  contractors. 

S.  Pizzo  (personal  communication, 
August  28, 2001)  and  G.  Morris  (personal 
communication,  August  1,  2001)  on  the 
government  side  and  T.  Black  (personal 
communication,  August  3,  2001)  on  the 
contractor  side  observed  that  the  interface 
between  ESL  and  the  government  pro¬ 
gram  office  was  much  like  an  integrated 
product  team  (IPT).  Long  before  these 
came  into  vogue  in  the  1990s,  ESL  and 
the  Guardrail  program  office  were  imple¬ 
menting  this  type  of  interorganizational 
project  coordination.  George  Morris  (per¬ 
sonal  communication,  August  1,  2001) 
observed  that  when  IPTs  were  formally 
implemented  in  the  1990s,  they  tended  to 
be  leaderless  groups  and  decisions  tended 
to  be  reached  by  consensus.  In  some 
instances  this  worked  well,  but  in  other 
cases  the  consensual  decision  making 
simply  did  not  work.  G.  Morris  (personal 
communication,  August  1,  2001)  noted 
that  in  the  1980s,  prior  to  the  formal  imple¬ 
mentation  of  IPTs,  the  interorganizational 
teams  in  the  Guardrail  program  were  not 
leaderless.  Typically,  the  government  pro¬ 
gram  office  retained  final  decision  author¬ 
ity.  However,  as  a  general  practice,  there 
was  deference  to  the  judgment  of  those 
who  had  the  greatest  technical  knowledge 
on  a  particular  matter.  This  approach 
seemed  to  work  more  effectively  than  the 
leaderless  IPT  approach. 

In  general,  the  government  program 
office  and  ESL  effectively  managed  the 
system  integration.  However,  there  was 
one  significant  exception.  This  was  the 
management  of  the  weight  for  the  Beech 
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aircraft  during  GR/CS  System  3  (CECOM, 
1992).  This  was  a  miscalculation  that 
Beech,  ESL,  and  the  Guardrail  program 
office  did  not  discover  until  System  3  was 
being  tested.  This  miscalculation  resulted 
in  the  need  to  re-engine  the  aircraft,  and 
this  led  to  serious  delays  in  the  comple¬ 
tion  and  fielding  of  GR/CS  System  3  (R. 
Ohlfs,  personal  communication,  August  6, 
2001;  Rawles,  1990).  The  problem  could 
have  been  avoided  if  Beech,  ESL,  the  other 
contractors,  and  the  Guardrail  program 
office  had  been  adequately  monitoring  the 
weight  problem.  If  discovered  earlier,  the 
replacement  of  engines  on  the  Beech  air¬ 
craft  could  have  then  occurred  concur¬ 
rently  so  that  the  original  schedule  could 
have  been  achieved. 

In  any  case,  G.  Morris  (personal  com¬ 
munication,  August  1,  2001)  of  CECOM 
concluded  that  integration  is  facilitated 
when  there  is  a  single  prime  contractor 
with  multiple  subcontractors,  and  the 
prime  contractor  assumes  total  responsi¬ 
bility  for  integration.  As  Guardrail  moved 
into  the  Common  Sensor  program,  the 
CHAALS  and  AQL  systems  were  fur¬ 
nished  to  ESL  through  the  government 
program  office  as  government  furnished 
equipment  (GFE).  ESL  had  responsibil¬ 
ity  for  integration,  but  the  relationships 
were  ostensibly  different  because  IBM 
was  not  a  subcontractor  to  ESL  for 
CHAALS.  Neither  were  UTL  Corporation 
or  ESCO  subcontractors  to  ESL  for  AQL. 

Like  G.  Morris  (personal  communica¬ 
tion,  August  1,  2001)  and  S.  Pizzo  (per¬ 
sonal  communication,  August  28,  2001), 
of  the  Guardrail  program  office,  observed 
that  systems  with  multiple  prime  contrac¬ 
tors  have  more  complex  integration 
problems.  Just  as  the  Navy  Battle  Group 
Passive  Horizon  Extension  System 


(BGPHES)  suffered  from  extensive  inte¬ 
gration  difficulties  due  to  multiple  gov¬ 
ernment  project  offices  with  multiple 
prime  contractors,  as  GR/CS  began  to 
move  in  a  similar  direction,  integration 
became  increasingly  problematic. 


Lesson  6.  A  Corporate  Culture  Can 
Affect  the  Success  of  a  Program 


Given  the  large  learning  curves  associ¬ 
ated  with  system  specific  technical  knowl¬ 
edge  on  complex  defense  systems,  conti¬ 
nuity  in  personnel  can  be  a  very  impor¬ 
tant  contributor  to  schedule  and  technical 
performance.  This  is  not  to  say  that  a  con¬ 
tinuous  infusion  of  new  talent  is  not  nec¬ 
essary.  This,  too,  is  essential  to  any  engi¬ 
neering  organization.  However,  managing 
turnover  and  retention  is  clearly  a  problem 
of  optimization. 

T.  Black  (personal  communication, 
August  3,  2001)  and  D.  Swainston  (per¬ 
sonal  communication,  August  3,  2001) 
observed  that  at  ESL  a  core  group  of 
engineers  worked  on  the  program  for  a 
number  of  years.  In  fact,  |/-" 
as  many  as  100  engi- 
neers  worked  on  the 
Guardrail  program  at 
ESL  for  a  duration  of  15 
years.  Since  each  Guard¬ 
rail  program  was  succes¬ 
sive,  there  were  no  gaps 
in  time  where  a  large  I  v  ; 
amount  of  turnover  and  ft  / 
new  hiring  had  to  occur.  This  continuity 
clearly  facilitated  organizational  learning 
and  the  enhancement  of  the  extraordinary 
base  of  expertise  at  ESL. 

T.  Black  (personal  communication, 
August  3,  2001)  and  R.  Ohlfs  (personal 


*  •••  systems  with 
multiple  prime 
contractors  have 
more  complex 
integration 
problems." 
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communication,  August  6,  2001)  sug¬ 
gested  that  several  important  factors  con¬ 
tributed  to  ESLs  ability  to  retain  such  a 
talented  cadre  of  engineers.  First,  ESL  was 
very  competitive  in  terms  of  salary  and 
benefits.  This  allowed  the  TRW  division 
to  attract  and  retain  highly  talented  indi¬ 
viduals.  Secondly,  the 
corporate  culture  created 
an  environment  that 
made  ESL  a  very  colle¬ 
gial  and  enjoyable  place 
to  work.  From  the  very 
beginning,  William  Perry 
(who  would  later  be¬ 
come  Secretary  of  De¬ 
fense)  tried  to  create  a 
very  close  knit,  cohesive 
climate  at  ESL.  Even  as  the  company  grew 
larger  and  became  a  division  of  TRW,  ESL 
still  maintained  a  highly  cohesive  and 
supportive  culture. 

A  third  factor  that  characterized  ESL 
was  a  corporate  culture  that  emphasized 
flexibility.  To  illustrate,  in  the  early  1980s, 
R.  Ohlfs  (personal  communication, 
August  6,  2001)  had  considered  leaving 
ESL.  His  reasoning  was  based  on  the  fact 
that  he  was  spending  an  inordinate  amount 
of  time  on  functional  management  tasks, 
and  he  missed  spending  the  larger  propor¬ 
tion  of  his  time  on  purely  technical  work. 
He  discussed  his  sense  of  diminishing 
job  fulfillment  in  terms  of  management 
responsibilities  with  the  president  of  ESL, 
Don  Jacobs.  Jacobs’  response  was  char¬ 
acteristically  atypical.  He  simply  said  that 
ESL  needed  to  create  a  work  environment 
where  talented  and  self-motivated  people 
are  free  to  do  what  they  do  best.  As  a  con¬ 
sequence,  the  company  introduced  a  type 
of  a  dual  career  ladder  where  exceptional 
engineers  could  progress  in  a  technical 


"...the  corporate 
culture  created 
an  environment 
that  made  ESL  a 
very  collegial 
and  enfoyable 
place  to  work." 


track  and  provide  technical  leadership  in 
the  company  without  being  burdened  with 
managerial  responsibility.  As  a  conse¬ 
quence,  R.  Ohlfs  (personal  communica¬ 
tion,  August  6,  2001)  stayed  another  17 
years. 

A  fourth  and  perhaps  most  important 
factor  that  contributed  to  retention  was  that 
the  engineers  working  on  the  Guardrail 
program  had  a  collective  vision  for  where 
the  technology  could  eventually  go. 
Furthermore,  they  understood  the  national 
importance  of  their  work  in  the  context  of 
the  ominous  threat  of  the  former  Soviet 
Union.  The  combination  of  these  impor¬ 
tant  factors  contributed  to  the  continuity 
in  the  base  of  expertise  that  was  success¬ 
fully  maintained  at  ESL. 


The  Implementation  of  a  Program 


Clearly  not  all  of  the  observations  from 
the  Guardrail  program  would  apply  to  the 
development  of  other  defense  systems. 
However,  consistent  with  contingency 
theories  of  management,  these  observa¬ 
tions  may  be  useful  in  the  identification 
of  determinants  for  the  implementation  of 
a  program  with  a  radical  reduction  in  cycle 
time,  and  the  identification  of  important 
characteristics  of  those  programs. 

Figure  1  summarizes  necessary  condi¬ 
tions  and  important  characteristics  of  pro¬ 
grams  that  require  radically  reduced 
schedules  based  on  the  observations  and 
lessons  learned  that  are  presented  in  the 
preceding  sections.  Such  programs  are 
only  necessary  when  the  time  parameters 
for  the  development,  production,  and 
fielding  of  a  system  are  critical.  These 
conditions  typically  arise  when  an  emerg¬ 
ing  threat  is  evolving  rapidly,  and  in 
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Figure  1. 

A  Model  of  Determinants  with  a  Radical  Reduction  in  Cycle  Time 


many  cases  where  certain  key  technolo¬ 
gies  are  evolving  rapidly  (thus  affecting 
the  evolving  threat). 

While  schedule  criticality  is  assumed 
for  a  program  with  a  radical  reduction  in 
cycle  time,  there  are  other  necessary  con¬ 
ditions  that  must  exist  for  the  implemen¬ 
tation  of  such  a  program.  First,  while  the 
core  technologies  will  be  state-of-the-art, 
they  must  be  sufficiently  mature  to  avoid 
significant  engineering  development  time 
in  the  schedule.  Secondly,  a  high  poten¬ 
tial  for  technology  insertion  in  the  form 
of  COTS  technologies  will  reduce  devel¬ 
opment  time.  Third,  systems  with  small 
production  quantities  are  advantaged  by 
the  fact  that  the  latter  stages  of  develop¬ 
ment  and  initial  stages  of  production  can 


occur  concurrently.  Furthermore,  iterative 
modifications  can  occur  as  a  result  of  test¬ 
ing  without  significant  cost  or  schedule 
implications.  With  systems  requiring  large 
production  runs  this  is  not  possible. 
Fourth,  as  was  the  case  with  Guardrail, 
such  programs  require  high  level  and  per¬ 
vasive  support  to  ensure  adequate  fund¬ 
ing  and  the  budgetary  stability  necessary 
to  optimize  schedule. 

Assuming  that  the  necessary  conditions 
are  extant,  the  lessons  learned  from  the 
Guardrail  program  suggest  several  impor¬ 
tant  characteristics  that  will  affect  the 
schedule  performance  of  a  program.  First, 
system  requirements  should  be  developed 
through  dialogue  with  the  technical  ex¬ 
perts  (both  government  and  contractor). 
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This  will  tend  to  facilitate  optimization 
of  schedule  through  the  systematic 
analysis  of  cost,  schedule,  and  techni¬ 
cal  performance  tradeoffs.  As  a  result, 
requirements  with  minimal  benefit,  or 
value  added,  but  large  cost  and  sched¬ 
ule  implications  should  be  minimized. 

A  second  characteristic  follows  from 
one  of  the  conditions  for  a  radically  re¬ 
duced  cycle  time  program.  Utilizing  state- 
of-the-art,  but  sufficiently  mature  tech¬ 
nology,  discipline  must  be  exercised  in 
the  development  process  to  avoid  de¬ 
sign  decisions  that  will  require  significant 
engineering  develop¬ 
ment.  A  third  character¬ 
istic  will  facilitate  suc¬ 
cessive  pre-planned 
product  improvements 
and  the  potential  to  con¬ 
tinually  upgrade  the 
system’s  capabilities 
with  controlled  sched¬ 
ule  implications  as  the 
technology  evolves. 
This  is  the  use  of  open 
architecture  as  it  was  successfully  dem¬ 
onstrated  in  the  Guardrail  program.  In¬ 
terrelated  with  the  use  of  open  architec¬ 
ture  and  the  use  of  mature  technology  is 
the  maximization  of  the  use  of  COTS 
technology.  Assuming  the  precondition 
for  a  high  level  of  COTS  exists,  maxi¬ 
mum  utilization  in  design  decisions  will 
tend  to  positively  affect  schedule.  How¬ 
ever,  it  should  be  noted  that  COTS  may 
also  result  in  increased  integration  com¬ 
plexities.  Therefore,  design  decisions 
must  optimize  the  use  of  COTS  in  light 
of  other  variables. 

A  fifth  characteristic  involves  the  prime 
contractor  being  relegated  full  responsi¬ 
bility  for  system  integration.  As  GR/CS 


"The  Aerial 
Common 
Sensor... is  a 
system  that  stands 
on  tha  shoulders 
of  giants  when 
one  views  its 
extraordinary 


began  to  deviate  from  this  pattern  there 
were  adverse  schedule  implications. 
Integration  is  facilitated  when  respon¬ 
sibility  is  not  diffused  among  multiple 
contractors  and  multiple  government 
program  offices. 

A  sixth  characteristic  of  an  effective 
quick  reaction  capability  program  is  in¬ 
terrelated  with  the  first  and  the  fifth  char¬ 
acteristics.  Based  on  the  lessons  learned 
from  Guardrail  is  the  selection  of  a  prime 
contractor  with  continuity  and  depth  in  the 
system  specific  base  of  expertise.  With¬ 
out  this  the  resultant  learning  curves  are 
such  that  the  program  schedule  will  be 
adversely  affected.  Furthermore,  without 
this  depth  of  expertise,  the  potential  for 
effectively  setting  requirements  through 
dialogue  is  greatly  diminished.  Similarly, 
the  potential  for  effective  integration  is 
also  diminished. 

Clearly,  other  characteristics  of  effec¬ 
tive  radically  reduced  cycle  time  programs 
exist.  The  characteristics  outlined  here 
have  been  drawn  from  the  lessons  learned 
from  the  Guardrail  program.  Other  char¬ 
acteristics  of  such  programs  should  be 
the  subject  of  future  research. 


Conclusion 


The  historical  development  of  the 
Guardrail  program  summarized  in  this 
case  suggests  that  this  evolution  of  ad¬ 
vanced  airborne  communications  and 
electronic  intelligence  systems  repre¬ 
sented  one  of  the  most  successful  defense 
systems  developed  during  the  last  third  of 
the  twentieth  century.  Based  on  measures 
of  program  cost,  schedule,  and  technical 
performance,  the  sequence  of  Guardrail 
systems  was  exceptional.  The  Guardrail 
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systems  provided  commanders  in  the  field 
with  critical  information  during  the  Cold 
War,  Desert  Storm,  and  the  conflict  in 
Central  Europe. 

As  the  program  proceeds  in  the  twenty- 
first  century,  the  COMINT  and  ELINT 
capabilities  will  be  adjoined  with  imagery 
intelligence  (IMINT)  and  measurement  sig¬ 
nature  intelligence  (MASINT)  capabilities. 


This  will  be  the  next  step  in  the  relentless 
succession  of  Guardrail  systems  and  it  will 
be  called  the  Aerial  Common  Sensor.  The 
Aerial  Common  Sensor  is  scheduled  to  be 
deployed  in  2010,  and  it  is  a  system  that 
stands  on  the  shoulders  of  giants  when  one 
views  its  extraordinary  technological 
heritage. 
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The  fall  2002  issue  of  the  Acquisition  Review  Quarterly  ( ARQ )  journal  contained 
some  very  interesting  articles.  The  one,  which  got  most  of  my  attention,  is  entitled 
“Using  Options  to  Manage  Dynamic  Uncertainty  in  Acquisition  Projects.” 

The  authors  make  the  following  statement  in  their  article.  “But  the  processes,  methods 
and  tools  for  developing  flexible  strategic  plans  and  adapting  to  changes  have  not  been 
operationalized  adequately  to  be  applied  to  management  of  dynamic  project  uncer¬ 
tainty.  Project  planning,  risk  management,  and  other  management  decision-making 
theories  also  do  not  provide  operational  processes  to  proactively  use  flexibility  to  manage 
project  uncertainty  (Ceylan  &  Ford,  2002,  p.  248). 

Although  I  disagree  with  this  statement,  I  tried  to  ascertain  if  there  was  really  any¬ 
thing  new  in  this  presentation.  However,  I  could  not  find  anything  new  as  the  article 
was  really  a  description  of  what  systems  engineering  should  do  if  properly  implemented. 
Broadly  defined,  system  engineering  is  not  only  flexible,  but  “the  effective  application 
of  scientific  and  engineering  efforts  to  transform  an  operational  need  into  a  defined 
system  configuration  through  the  top-down  iterative  process  of  requirements  defini¬ 
tion,  functional  analysis,  synthesis,  optimization,  design,  test,  and  evaluation”  (Blanchard, 
1991,  p.  12). 

In  addition,  system  engineering  can  be  broken  down  into  four  major  steps  as  follows: 
A  top-down  approach,  a  life-cycle  orientation,  a  better  and  complete  effort  regarding 
initial  identification  of  system  requirements,  and  an  interdisciplinary  approach  through 
design  and  development  (Blanchard,  1991,  p.  13). 

Starting  with  system  design,  any  number  of  design  proposals  or  alternatives  may  be 
considered,  with  several  contracts  competing  for  the  most  promising.  Ample  clauses 
protect  the  government’s  right  to  design  data  regardless  of  the  termination  of  some  of 
the  design  efforts.  This  data  may  contain  alternatives  for  components  which  may  result 
in  development  contracts  to  reduce  risk. 

One  of  the  elements  of  the  design  evaluation  process  is  the  evaluation  of  risk  and 
uncertainty.  These  terms  tend  to  be  used  interchangeably,  but  “risk  actually  implies  the 
availability  of  discrete  data  in  the  form  of  a  probability  distribution  around  a  certain 
parameter.  Uncertainty  implies  a  situation  that  may  be  probabilistic  in  nature,  but  one 
that  is  not  supported  by  discrete  data”  (Blanchard,  1991,  p.  51).  The  aspects  of  risk  and 
uncertainty  must  be  incorporated  in  the  part  of  systems  engineering  called  the  Program 
Risk  Management  Plan,  which  is  a  part  of  the  overall  Systems  Engineering  Management 
Plan. 
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The  use  of  options  in  the  acquisition  field  has  been  around  a  long  time.  Most  research 
and  development  contracts  provide  for  options  to  change  the  direction  of  the  effort, 
increase  funding,  and  extend  completion,  as  well  as  a  unilateral  right  of  the  government 
to  terminate  the  effort. 

As  noted  in  the  ARQ  article,  uncertainty  is  difficult  to  program,  however  it  has  been 
a  recognized  part  of  program  management  for  many  decades  and  highlighted  during 
the  1970s  by  Dr.  John  S.  Foster  Jr.,  (then  Director  of  Defense  Research  and  Engineer¬ 
ing,  Department  of  Defense),  who  called  the  problem  “unk-unks”  or  “unknown 
unknowns.”  Each  program  manager  on  the  Defense  Acquisition  Review  Council 
(DSARC)  at  that  time  was  questioned  about  unknown-unknowns,  with  much  discus¬ 
sion  of  statistical  probability  theory,  financial  provisions,  and  alternatives.  However  the 
best  of  theory  could  not  provide  for  example  the  aftermath  of  September  11,  2001,  the 
impact  of  action  in  Iraq,  the  oil  problems  generated  by  strikes  in  Venezuela,  the  Stevedore 
strike  in  California.  It  is  however  the  major  job  of  a  program  manager  to  manage  uncer¬ 
tainty  and  that  is  the  real  test  of  his/her  management  skills.  The  flexibility  and  tools 
provided  by  system  engineering  which  include  evaluation  of  uncertainties,  a  compre¬ 
hensive  Work  Break  Down  Structure  (WBS),  and  a  constant  program  review  process 
provides  the  vehicle  for  minimizing  the  difficulties  caused  by  uncertainty. 

Most  Program  Managers  hold  a  rainy  day  fund,  and  it  would  be  great  to  hedge  against 
all  bets,  but  the  best  of  option  theory  will  not  forecast  or  protect  against  uncertainties 
such  as  labor  unrest,  subcontractor  bankruptcy,  acts  of  God  (Earthquakes,  hurricanes, 
floods,  and  fire).  Is  there  a  statistical  probability  that  one  or  more  of  these  will  occur 
and  impact  an  ongoing  system  acquisition?  Yes  there  is  and  it  is  calculable,  but  the 
probability  is  so  large  most  PMs  do  not  insure  their  programs  against  it,  any  more  than 
the  government  provides  knowing  contingency  funding  or  funds  overruns  before  they 
occur.  Options  which  are  defined  in  the  Merriam -Webster’s  Collegiate®  Dictionary  (1994) 
as  the  power  or  right  to  choose:  freedom  of  choice,  a  privilege  of  demanding  fulfillment 
of  a  contract  on  any  day  within  a  specified  time,  and  a  contract  conveying  a  right  to  buy 
or  sell  designated  securities,  commodities,  or  property  interest  at  a  specified  price  during 
a  stipulated  period  (p.  817),  as  follows  and  are  expensive  insurance,  as  any  right  under 
a  contract  costs  money. 

Also  noted  in  the  article,  the  use  of  options  is  not  new.  They  may  be  contractual,  part 
of  the  program  plan  or  in  the  head  of  the  program  manager,  and  it  is  doubtful  if  any 
theory  can  aide  in  the  management  of  uncertainty,  given  the  dynamics  of  the  environ¬ 
ment  in  which  we  develop  new  systems,  whether  in  industry  or  in  government.  The 
major  players  in  system  acquisition  are:  the  contractor  and  staff,  the  program  manager 
and  staff,  the  Service  of  the  program  manager  and  staff,  the  Office  of  the  Secretary  of 
Defense  and  staff,  the  Congressional  Committees  and  their  staffs,  and  various  subcon¬ 
tractors.  With  that  much  uncertainty  created  with  that  many  participants,  the  following 
is  considered  appropriate  “Consider  now  a  participant  in  a  social  exchange  economy. . .. 
Each  participant  attempts  to  maximize  a  function  of  which  he  does  mot  control  all 
variables. ...  One  would  be  mistaken  to  believe  that  [this  kind  of  problem]  can  be  obvi¬ 
ated  by  a  mere  recourse  to  the  devices  of  the  theory  of  probability.  Every  participant 
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can  determine  the  variables  which  describe  his  own  actions  but  not  those  of  others. 
Nevertheless  those  ‘alien’  variables  cannot,  from  his  point  of  view,  be  described  by 
statistical  assumption”  (Von  Neumann  &  Morgenstem,  1994,  pp.  9-11). 

There  are  several  classic  programs  where  options  were  used  quite  successfully,  but 
in  different  environments,  different  priorities,  different  funding  structure,  different  tim¬ 
ing,  different  political  environment,  different  technologies,  and  different  complexities. 
The  F111B,  Polaris/Poseidon,  the  nuclear  submarine  program;  the  Joint  Aircraft  Engine 
development,  the  development  of  solar  energy;  and  from  long  ago  the  Manhattan  project 
are  examples.  Trying  to  model  uncertainty  is  like  trying  to  model  the  movement  of  the 
stern  of  an  aircraft  carrier  in  heavy  seas. 

In  closing,  as  a  famous  program  manager  said  to  other  junior  PMs:  “You  have  got  to 
keep  your  options  open.  ” 


Rowland  G.  Freeman  III 
E-mail:  rowlandf@aol.com 
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ATTENTION 

Military  Officers, 
Defense  Industry, 
Government  Executives, 
University  Professors, 


Graduate  Students! 


THIS  IS  YOUR  OPPORTUNITY 
TO  CONTRIBUTE  TO 
DOD  ACQUISITION, 
TECHNOLOGY  AND 
LOGISTICS  EXCELLENCE 


CAIIFORPAPERS 


The  AT&L  PM  Cop  is  calling  for  papers  on  the 
yg?  “Essential  Program  Management  Models  and  Endur- 
ing  Principles:  What  Every  Weapons  Acquisition  PM 
:#|j  Should  Understand.”  Selected  papers  will  run  the 
gamut  of  the  weapons  system  acquisition  disciplines, 
but  essential  pieces  will  fall  into  the  categories  of 
people,  processes,  products,  and  politics.  The  papers 
should  reflect  theoretical  constructs  that  have  critically 
passed  the  test  of  time,  should  include  such  essential 
frameworks  as  Performance  Measurements  and  Inte¬ 
grated  Product  and  Process  Development  (IPPD), 
must  include  a  description  of  the  model,  examples  of 
its  successful  application,  and  the  takeaway  from  real 
experience. 

Two-page  abstracts  are  due  December  31,  2003. 
Papers  will  be  presented  in  a  special  track  of  panels  at 
the  June  2003  DAU  Alumni  Association  conference  at 
Fort  Belvoir,  VA.  All  selected  conference  papers  will 
be  WEB  published  on  the  PM  Cop  Web  site.  Seven 
outstanding  papers  will  be  part  of  the  special  Summer 
2004  edition  of  the  ARQ.  Further  details  about  the 
“Essential  Models”  effort  can  be  found  at  http:// 

.]  pmcop.dau.mil/essentialmodels. 

Who  to  Contact 

To  inquire  about  the  “Essential  Program  PM 
Models”  project  contact  the  DAU  project  leaders, 
Professor  John  Driessnack  at  703-805-4655; 
john.driessnack@dau.mil  or  Dr.  Mary-jo  Hall  at  703- 
805-4943;  mary-jo.hall@dau.mil. 

Special  Call  for  Research  Articles 

We  publish  DoD  AT&L  research  articles  that  in¬ 
volve  systematic  inquiry  into  significant  research 
questions.  Each  article  must  produce  a  new  or  re¬ 
vised  theory  of  interest  to  the  DoD  AT&L  commu¬ 
nity.  We  welcome  sponsorship  of  special  editions  of 
the  ARQ.  If  interested,  e-mail  Dr.  Robert  Ainsley  at 
bob.ainsley@dau.  mil . 

Acquisition  Review  Quarterly  is  listed  in  Cabell’s  Direc¬ 
tory  of  Publishing  Opportunities  in  Management  and 
Marketing. 
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ACQUISITION  REVIEW  QUARTERLY 
GUIDELINES  FOR  CONTRIBUTORS 


The  Acquisition  Review  Quarterly 
(ARQ)  is  a  scholarly  peer-reviewed 
journal  published  by  the  Defense  Acqui¬ 
sition  University  (DAU).  All  submissions 
receive  a  blind  review  to  ensure  impartial 
evaluation. 


In  General 


We  encourage  prospective  authors  to 
co-author  with  others  to  add  depth  to  their 
submissions.  It  is  recommended  that  a 
mentor  be  selected  who  has  published 
before  or  has  expertise  in  the  subject  pre¬ 
sented  in  the  manuscript. 

Authors  should  become  familiar  with 
the  construction  of  previous  ARQs  and 
adhere  to  the  use  of  endnotes  versus  foot¬ 
notes,  formatting  of  bibliographies,  and 
the  use  of  designated  style  guides.  It  is 
also  the  responsibility  of  the  correspond¬ 
ing  author  to  furnish  government  agency/ 
employer  clearance  with  each  submission. 

Submissions 


We  welcome  submissions  from  anyone 
involved  in  the  defense  acquisition  pro¬ 
cess.  Defense  acquisition  is  defined  as  the 
conceptualization,  initiation,  design, 
development,  testing,  contracting,  pro¬ 
duction,  deployment,  logistic  support, 
modification,  and  disposal  of  weapons  and 


other  systems,  supplies,  or  services  needed 
by  the  Defense  Department,  or  intended 
for  use  to  support  military  missions. 

Research  Articles 


Manuscripts  should  reflect  research  or 
empirically  supported  experience  in  one 
or  more  of  the  aforementioned  areas  of 
acquisition.  Research,  lessons  learned  or 
tutorial  articles  should  not  exceed  4,500 
words.  Opinion  articles  should  be  limited 
to  1,500  words. 

Research  articles  are  characterized  by 
a  systematic  inquiry  into  a  subject  to 
discover/revise  facts  or  theories. 

Manuscript  Sections 


A  brief  abstract  provides  a  compre¬ 
hensive  summary  of  the  article  and  must 
accompany  your  submission.  Abstracts 
give  readers  the  opportunity  to  quickly 
review  an  articles’  content  and  also  allow 
information  services  to  index  and  retrieve 
articles. 

The  introduction,  which  should  not  be 
labeled,  opens  the  body  of  the  paper  and 
states  the  problem  being  studied  and  the 
rationale  for  the  research  undertaken. 

The  methods  section  should  include  a 
detailed  methodology  that  clearly  de¬ 
scribes  work  performed.  Although  it  is 
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appropriate  to  refer  to  previous  publica¬ 
tions  in  this  section,  the  author  should 
provide  enough  information  so  that  the 
experienced  reader  need  not  read  earlier 
works  to  gain  an  understanding  of  the 
methodology. 

The  results  section  should  concisely 
summarize  findings  of  the  research  and 
follow  the  train  of  thought  established  in 
the  methods  section.  This  section  should 
not  refer  to  previous  publications,  but 
should  be  devoted  solely  to  the  current 
findings  of  the  author. 

The  discussion  section  should  empha¬ 
size  the  major  findings  of  the  study  and 
its  significance.  Information  presented  in 
the  aforementioned  sections  should  not  be 
repeated. 


Research  Considerations 


Contributors  should  also  consider  the 
following  questions  in  reviewing  their  re- 
search-based  articles  prior  to  submission: 

•  Is  the  research  question  significant? 

•  Are  research  instruments  reliable  and 
valid? 

•  Are  outcomes  measured  in  a  way 
clearly  related  to  the  variables  under 
study? 

•  Does  the  research  design  fully  and 
unambiguously  test  the  hypothesis? 

•  Did  you  build  needed  controls  into  the 
study? 

Contributors  of  research-based  submis¬ 
sions  are  also  reminded  they  should  share 


any  materials  and  methodologies  neces¬ 
sary  to  verify  their  conclusions. 

Criteria  For  Tutorials 


Tutorials  should  provide  special  in¬ 
struction  or  knowledge  relevant  to  an  area 
of  defense  acquisition  to  be  of  benefit  to 
the  Department  of  Defense  Acquisition, 
Technology  and  Logistics  Workforce. 

Topics  for  submission  should  rely  on 
or  be  derived  from  observation  or  experi¬ 
ment,  rather  than  theory.  The  submission 
should  provide  knowledge  in  a  particular 
area  for  a  particular  purpose. 

Opinion  Criteria 


Opinion  articles  should  reflect  judg¬ 
ments  based  on  the  special  knowledge  of 
the  expert.  Opinion  articles  should  be 
based  on  observable  phenomena  and  pre¬ 
sented  in  a  factual  manner;  that  is,  sub¬ 
missions  should  imply  detachment.  The 
observation  and  judgment  should  not  re¬ 
flect  the  author’s  personal  feelings  or 
thoughts.  Nevertheless,  an  opinion  piece 
should  clearly  express  a  fresh  point  of 
view,  rather  than  negatively  criticize  the 
view  of  another  previous  author. 

Manuscript  Style 


We  will  require  you  to  recast  your  last 
version  of  the  manuscript,  especially  ci¬ 
tations  (endnotes  instead  of  footnotes)  into 
the  format  required  in  two  specific  style 
manuals.  The  ARQ  follows  the  author 
(date)  form  of  citation.  We  expect  you  to 
use  the  Publication  Manual  of  the  American 
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Psychological  Association  (5th  Edition), 
and  the  Chicago  Manual  of  Style  (14th 
Edition). 

Contributors  are  encouraged  to  seek  the 
advice  of  a  reference  librarian  in  complet¬ 
ing  citations  of  government  documents 
because  standard  formulas  of  citations 
may  provide  incomplete  information  in 
reference  to  government  works.  Helpful 
guidance  is  also  available  in  Garner,  D. 
L.  and  Smith,  D.  H.,  1993,  The  Complete 
Guide  to  Citing  Government  Documents: 
A  Manual  for  Writers  and  Librarians  (Rev. 
Ed.),  Bethesda,  MD:  Congressional  Infor¬ 
mation  Service,  Inc. 

Copyright  Information 


The  ARQ  is  a  publication  of  the  United 
States  Government  and  as  such  is  not 
copyrighted.  Because  the  ARQ  is  posted 
as  a  complete  document  on  the  DAU  home 
page,  we  will  not  accept  copyrighted 
articles  that  require  special  posting  re¬ 
quirements  or  restrictions.  If  we  do  pub¬ 
lish  your  copyrighted  article,  we  will  print 
only  the  usual  caveats.  The  work  of  fed¬ 
eral  employees  undertaken  as  part  of  their 
official  duties  is  not  subject  to  copyright 
except  in  rare  cases. 

In  citing  the  work  of  others,  it  is  the 
contributor’s  responsibility  to  obtain  per¬ 
mission  from  a  copyright  holder  if  the  pro¬ 
posed  use  exceeds  the  fair  use  provisions 
of  the  law  (see  U.S.  Government  Printing 
Office,  1994,  Circular  92:  Copyright  Law 
of  the  United  States  of  America,  p.  15, 
Washington,  DC:  Author).  Contributors 
will  be  required  to  submit  a  copy  of  the 
written  permission  to  the  Managing  Editor 
before  publication. 


Copyright  Policy 


We  reserve  the  right  to  decline  any 

article  that  falls  into  these  problem  copy¬ 
right  categories: 

•  The  author  cannot  obtain  official  per¬ 
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